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Abstract. In this paper we are concerned with a class of stochastic Volterra integro-difFerential 
problems with completely monotone kernels, where we assume that the noise enters the system when 
we introduce a control. We start by reformulating the state equation into a semilinear evolution 
equation which can be treated by semigroup methods. The application to optimal control provide 
other interesting result and require a precise descriprion of the properties of the generated semigroup. 

The first main result of the paper is the proof of existence and uniqueness of a mild solution for 
the corresponding Hamilton-Jacobi-Bellman (HJB) equation. The main technical point consists in 
the differentiability of the BSDE associated with the reformulated equation with respect to its initial 
datum X. 
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1. Introduction. We are concerned with the following optimal control problem 
for an infinite dimensional stochastic integral equation of Volterra type on a separable 
Hilbert space H: 



In the above equation W{t), t > is a cylindrical Wiener process defined on a 
suitable probability space {Tt)t>o,'^) (whose properties will be specified later) 

with values into a (possibly different) Hilbert space S; the unknown u(-), representing 
the state of the system, is an 7J-valued process. Also, the control is modellized by 
the predictable process 7 with values in some specified subset U (the set of control 
actions) of a third Hilbert space U. 

The kernel a is completely monotonic, locally integrable and singular at 0; A is a 
linear operator which generates an analytical semigroup; g is bounded linear mapping 
from S into H and r is a bounded Borel measurable mapping from [0,T] x H x U 
into S. We notice that the control enters the system togheter with the noise. 

The optimal control that we wish to treat in this paper consists in minimizing a 
cost functional of the form 



where I and cj) are given real- valued functions. 

We adopt the semigroup approach based on the complete monotonicity of the 
kernel as been initiated in [M] |32] and recently developed for the stochastic case 
in O m [5] . Within this approach, equation (|1.1|) is reformulated into an abstract 
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stochastic evolution equation without memory on a different Hilbert space X. Namely, 
we rewrite equation (jl.ll) as 

'dx(t) = Bx{t)dt + (/ - B)Pf{t, Jx(i))di 

+ (/ - B)Pgir{t, Jx(t), j{t))dt + dWit)) (1.3) 

^x(O) = X. 

Here B is the infinitesimal generator of an analytic semigroup e*^ on X. P : H ^ X 
is a linear mapping which acts as a sort of projection into the space X. J : D{J) C 
X H is a,n unbounded linear functional on X, which gives a way going from x to 
the solution to problem p.ip . In fact, it turns out that u has the representation 



[jx(i), t>0, 
~\uo{t), t<0. 



For more details, we refer to the original papers [3l I26j. 

Further, the optimal control problem, reformulated into the state setting X, con- 
sists in minimizing the cost functional 

J(x, 7) E / l{t, Jx{t),-f{t))dt + E(/.( Jx(T)) 



(where the initial condition uq is substituted by x and the process u is substituted by 
Jx). It follows that 7 is an optimal control for the original Volterra equation if and 
only if it is an optimal control for that state equation (|1.3p . 

We notice that equation (|1.3p has unbounded coefficients. Similar stochastic prob- 
lems are present in literature (see [13l El [HI [301 135] ) , also in connection with optimal 
control. Usually, they arise in a wide variety of applications in physical problems, 
see the monograph [231 137] for some examples, in interacting biological populations 
and harvesting problems and in problems in mathematical finance. For instance, an 
example of physically realistic situation which we have in mind is the control of a fluid 
in the context of thermo-dynamic or fractional diffusion- wave equations. 

Our purpose is not only to prove existence of optimal controls, but mainly to 
characterize them by an optimal feedback law. In other words, we wish to perform 
the standard program of synthesis of the optimal control that consists in solving the 
associated forward-backward stochastic differential equation. In our case, this is given 

by 

UYis)=^,{s,^{s,t,x),Zis))ds + Z{s)dWis), s€[t,T], 
\y(r) = 0(x(T,s,:r)) 

where ip is the hamiltonian function of the control problem, defined in terms oil and r, 
while x(s, t, x) stands for the solution of equation (|1.3p starting at time t from x G X. 
It is classical that, under suitable assumption on ^, r and cj), problem (|1.4p admits 
a unique (weak) solution. We set v{t,x) = Y{t). Then, for any t G [0,T],a; S X^, 
v{t, x) is the value function of the control problem, that is to say, it realizes the average 
minimal cost "payed" by the system starting at time t in x. More precisely, v satisfies 
the so-called fundamental relation: 



J(a;, 7) = v{0, x)+E [ -iP{s, x(s), Vw(s, x(s))(/ - B)Pg) 
Jo 

+ V«(s, x(s))(/ - B)Pg r(s, Jx(s), 7(5)) + l{s, Jx(s), 7(5)) ] ds. (1.5) 
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We notice that the above expression requires v to be Gateaux difTerentiable and 
Wv{t,x{t)){I — B)Pg to be well-defined. As we will see, to prove these facts, the 
crucial point is to show that we can give a sense to Vu(t,x(i))(/ — B)Pg and to 
identify it with the process Z coming from the BSDE associated with the control 
problem. In fact we recall that P acts from H into Xg and it turns out that Pg 
does not belong to D{B) but only to an interpolation space {X, D{B))g, for suitable 
9 G (0, 1). Hence we are forced to prove that the map {t, x, h) i— ?• Vv{t, x)(/ — BY~^h 
extends to a continuous map on [{),T] x X x X . To do that, we start by proving 
that this extra regularity holds, in a suitable sense, for the forward equation (jl.3p and 
then it is conserved if we differentiate (in Gateaux sense) the backward equation with 
respect to the process x. 

On the other hand, showing first that x(-, i, x) is regular in Malliavin sense, we can 
prove that if the map (t, x, h) iH- Vf (i, x){I ~ B)^~^ h extends to a continuous function 
on [0,T] X X X X then the processes t H> v{t,x{t; ,x)) and W admit joint quadratic 
variation in any interval [s,t] and this is given by Vi'(r, x(r; s, — B)Pgdr. 
Then we proceed exploiting the characterization of Z{r)dr as joint quadratic vari- 
ation between Y and W in [s,t]. As a consequence, the identification between Z and 
Vw(t, x){I — B)P g follows by the definition of v. 

Once the fundamental relation has been shown, we will be able to construct 
the optimal feedback law. In fact, equality (jl.Sp immediately implies that for every 
admissible control 7 and any initial datum x, we have JJ(a;,7) > v{Q,x) and 7 is 
optimal if and only if the following feedback law holds: 

VXt,x^(t),V^;(i,x^(t))(/-i3)P.g) 

= ^v{t,^-<{t)) [I - B)Pgrit,Jx'<it),-fit)) + /(i, Jx^(t),7(i)) 

where x''' is the trajectory starting at x and corresponding to the control 7 (see 
Corollary 1131). 

The present paper is a first step of our program. Indeed, we consider a stochastic 
optimal control problem on finite horizon and under nondegeneracy assumptions on 
the diffusion coefficient g. Further, we suppose that r and I are Borel measurable 
S-valued functions sufficiently smooth in order that the Hamiltonian tp is Lipschitz 
continuous with respect to 7. In this way the the corresponding BSDE has sublinear 
growth in the variable Z and can be exploited, e.g., using the techniques developed 
in Fuhrman and Tessitore [21j or Confortola and Briand 

We notice that an optimal control problem for stochastic Volterra equations is 
treated in |5J , where the drift term of the equation has a linear growth on the control 
variable, the cost functional has a quadratic growth, and the control process belongs 
to the class of square integrable, adapted processes with no bound assumed on it. The 
substantial difference, in comparison with the cited paper, consists in the fact that, 
at our knowledge, our paper is the first attemp to study existence and uniqueness 
of solutions for the (HJB) equation corresponding to the Volterra equation (jl.ip and 
characterize the optimal control by a feedback law. 

The paper is organized as follows: the next section is devoted to notations; in 
Section [3] we transpose the problem in the infinite dimensional framework; in Section 
|4]we establish the existence result for the uncontrolled equation, while in Section [5] we 
study the controlled system. In section [6] we study the regularity of the uncontrolled 
solution, in particular in the sense of Malliavin, while in Section [7] we will study the 
BSDE associated to the problem. Finally, in Section[5]we will study the corresponding 
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(HJB) equation in order to construct an optimal feedback and an optimal control (see, 
to this end, Section IH]). 

2. Notations and main assumptions. The norm of an element a; of a Banach 
space E will be denoted by \x\e or simply \x\ if no confusion is possible. If F is 
another Banach space, L{E^ F) denotes the space of bounded linear operators from 
E to F, endowed with the usual operator norm. 

The letters S, H, U will always denote Hilber spaces. Scalar product is denoted 
( • , • ) , with a subscript to specify the space, if necessary. All Hilbert space are assumed 
to be real and separable. 

By a cylindrical Wiener process with values in a Hilbert space S, defined on a 
probability space {n,,T,F), we mean a family {W{t))t>o of linear mappings from S 
to L'^in), denoted ^ ^ W{t)) such that 

1. for every ^ G S, ((^, W{t)))t>o is a real (continuous) Wiener process; 

2. for every ^1,6 G S and i > 0, £((^1, PF(i))(6, W^(i))) = 

{J^t)t>o will denote the natural filtration of W, augmented with the family of 
P-nuU sets. The filtration {Tt)t>o satisfies the usual conditions. All the concepts of 
measurability for stochastic processes refer to this filtration. By B(T) we mean the 
Borel cr- algebra of any topological space T. 

In the sequel we will refer to the following class of stochastic processes with values 
in an Hilbert space K: 

1. LP{i}; L'^{0,T; K)) defines, for T > and p > 1, the space of equivalence 
classes of progressively measurable processes y : il x [0,T) ^ K, such that 

I \p 

\y\LP{n;L^(0,T;K)) ■~ 

Elements of LP(yi\ L^{0, T; K)) are identified up to modification. 

2. LP{n;C{[0,T];K)) defines, for T > and p > I, the space of equivalence 
classes of progressively measurable processes y : ft x [0,T) ^ K , with con- 
tinuous paths in K, such that the norm 

\y\^LP{n;C{[0,T];K)) ■~ 

is finite. Elements of LP{il;C{[0,T]; K)) are identified up to indistinguisha- 
bility. 

We also recall notation and basic facts on a class of differentiable maps acting 
among Banach spaces, particularly suitable for our purposes (we refer the reader to 
Fuhrman and Tessitore j21] or Ladas and Lakshmikantham [29l Section 1.6] (1970) for 
details and properties. Let now X, Y, V denote Banach spaces. We say that a mapping 
F : X V belongs to the class Q^{X, V) if it is continuous. Gateaux differentiable 
on X, and its Gateaux derivative VF : X — > L{X, V) is strongly continuous. 

The last requirement is equivalent to the fact that for every h G X the map 
\/F{-)h : X —i' V is continuous. Note that VF : X L{X, V) is not continuous in 
general if L{X, V) is endowed with the norm operator topology; clearly, if it happens 
then F is Frechet differentiable on X. It can be proved that if G Q^{X,V) then 
{x,h) tH> VF{x)h is continuous from X x X to V; if, in addition, G is in Q^{V,Z) 
then G{F) is in G^iX, Z) and the chain rule holds: V(G(i^))(x) = \7G{F{x))\7 F{x). 
When F depends on additional arguments, the previous definitions and properties 



\y{s)\K<is 



< oo. 



sup \yit)fK 
te[o,T] 
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have obvious generalizations. In addition to the ordinary chain rule stated above, a 
chain rule for the Malliavin derivative operator holds: for the reader convenience we 
refer to Section iG.ll for a brief introduction to this subject. 

Moreover, we assume the following. 

Hypothesis 2.1. 

1. The kernel a : {0,oo) W is completely monotonic, locally integrable, with 
a(0+) = +00. The singularity in shall satisfy some technical conditions 
that we make precise in Section\^ 

2. A : D{A) <Z H ^ H is a sectorial operator in H. Thus A generates an 
analytic semigroup e*'^. 

3. The function f : [0,T] x H ^ H is measurable, for every t £ [0, T] the 
function f(t, • ) : H ^ H is continuously Gateaux difjerentiable and there 
exist constants L > and C > such that 

\f{t,u)^ fit,v)\<L\u-vl te[0,T], u,veH; 
l/(t,0)| + ||V„/(i,M)||£(H) < C, te [0,T], ueH 

4- g belongs to L2(S, i/), that is to the space of Hilbert- Schmidt operators from 
S to H, endowed with the Hilbert- Schmidt norm ||g||^_^p = Tr(gg*). 

5. The function r : [0, T] x _ff x [/ — > S zs Borel measurable for a.e. t G [0,T] 
and there exists a positive constant C > such that 

k(i,ui,7) - 'r{t,U2,-i)\ < C(l + |ui| + |u2|)|mi - M2I), Ui,U2 € H,j eU; 
\r{t,u,-f)\s<C, u^HrieU. 

6. The process (M^(t))t>o is a cylindrical Wiener process defined on a complete 
probability space {^,J-, (-7^t)t>o,P) with values in the Hilbert space S. 

The initial condition satisfies a global exponential bound as well as a linear growth 
bound as t 0: 

Hypothesis 2.2. 

1. There exist Mi > and uj > such that \uo{t)\ < Mie"* for all t < 0; 

2. There exist M2 > and t > such that \uo{t) - uo(0)| < M2\t\ for all 
te[-T,0]; 

3. uo(0) e H^ for some e e (0, 1/2). 

Concerning the functions I and appearing in the cost functional we make the 
following general assumptions: 
Hypothesis 2.3. 

1. The functions I : [0,T] x H x U ^ R and : _ff — 5- K are Borel measurable; 

2. There exist a positive constant C and fc G N such that for any "f ^ U the 
following bound is satisfied 

\l{t,Ui,-f)-l{t,U2,j)\ < C{1 + \ui\ + \U2\)\UI -U2I), Ml, 1*2 e e U 

0<\l{t,0,j)\<C. 

3. There exists L > such that, for every ui,U2 € H we have 

|(/)(wi) - 0(u2)|if < L\ui - U2\h- 



Moreover, (j) G g^{H,M). 
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We consider the following notion of solution for the Volterra equation p.ip . 

Definition 2.4. We say that a process u — {u{t))t>o is a solution to equation 
(|l.ip if u is an adapted, p-mean integrable, continuous H -valued predictable process 
and the identity 

a{t-s){u{s)X)Hds={uX)H+ / (M(s),A*C)ffds 

-oo JQ 

+ / {f{s,u{s))X)As+ f {gr{s,u{s),j{s)),OHds + {gW{t),0 
Jo Jo 

holds V-a.s. for arbitrary t 6 [0,T] and ^ G £'(^4.*), with A* being the adjoint of the 
operator A and 

.0 

u — a{—s)uo{s)ds. 



3. The analitical setting. A completely monotone kernel a : (0, oo) ^ M is a 

continuous, monotone decreasing function, infinitely often derivable, such that 

d" 

{-ir^a{t) > 0, te (0, oo), n = 0, 1, 2, . . . 

By Bernstein's theorem, a is completely monotone if and only if there exists a positive 
measure v on [0, oo) such that 

a{t) ^ I e-'^^v{dn), t > 0. 

J[0,oo) 

Under the assumpion a G L^{0, 1), it holds that the Laplace trasform d is well defined 
and it is given in terms of v by 

d{s) — j i^{dK). 

J[0,oo) S + K 

We introduce the quantity 

1 



a{a) = sup |/9 e M : J 



sP ^— -ds < oo 

a[s) 



and we make the following assumption: 
Hypothesis 3.1. a{a) > 1/2. 

Remark 3.2. It is known from the theory of deterministic Volterra equations that 
the singularity of a helps smoothing the solution. We notice that a{a) is independent 
on the choice of c > and this quantity describes the behaviour of the kernel nearO; by 
this way we ensure that smoothing is suffiecient to keep the stochastic term tractable. 

It is known that we can associate to any completely monotone kernel a, by means 
of Bernstein's Theorem [37; pag. 90], a measure v on [0, +oo) such that 

ait) = j e-'^'vidn). (3.1) 

"'[0,+oo) 
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From the required singularity of a at 0+ we obtain that z^([0,+oo)) — a(0+) — +00 
while for s > the Laplace transform a of a verifies 

^(■s) = / v{dK) < +00. 

J[0,+oo) S + K 

Under the assumption of complete monotonicity of the kernel, a semigroup ap- 
proach to a type of abstract integro-differential equations encountered in linear vis- 
coelasticity was introduced in [T3] and extended to the case of Hilbert space valued 
equations in [3] . In order to simplify the exposition we quote from [3 the main result 
concerning the derivation of the state equation (|1.3p . 

We will see that this approach allow to treat the case of semilinear, stochastic 
integral equations; we start for simplicity with the equation 

J^J_ ait-s)uis)ds^Au{t) + fit), te[0,T] 

u{t) = uo{t), t < 0, 

where / belongs to L^{0,T; X). The starting point is the following identity, which 
follows by Bernstein's theorem 

a{t - s)uis) ds ^ f [ e"''^^-''^ v(dK)u{s)ds= [ x(i,K)i/(dK) 

-00 J -00 J [0, + 00) v/[0, + oo) 

where we introduce the state variable 

x{t,K)= f e-''(*-")u(s)ds. (3.3) 
Formal differentiation yields 

d 

— x(i, k) = -Kx(t, k) + w(t), (3.4) 
dt 

while the integral equation p. 21) can be rewritten 

(-Kx(t, k) + u{t)) iy{dK) = Au{t) + f{t). (3.5) 

[0,+oo) 

Now, the idea is to use equation (j3.4p as the state equation, with i?x = — kx(k) + u, 
while (|3.5p enters in the definition of the domain of B. 

In our setting, the function x(t, •) will be considered the state of the system, 
contained in the state space X that consists of all Borel measurable functions y : 
[0, +c>o) — > H such that the seminorm 



l,--,l|2 / t.^ , iM„/„m2 

'[0, + CX)) 



X - I (« + i)|y('«)lH^(dK) 



is finite. We shall identify the classes y with respect to equality almost everywhere 
in V. 

Let us consider the initial condition. We introduce the space 
Xq := {u-.M.^ ^ H : exists M >0 and uj > s.t. |u(i)| < Me"*, t < O} 



8 



F. Confortola E. Mastrogiacomo 



and we endow it with a positive inner product 

{u,v)x= / [a{t + s)-a'{t + s)]{u{-s),v{-t))Hdsdt- 



then, setting iVo = {u £ Xq : {u, u)-^~ 0}, (•, ■)-^ is a scalar product on Xq/ Nq; we 
define X the complctition of this space with respect to {■,-)x- We let the operator 
Q : X ^ X he given by 

x(0,k) = guo(K) = / e^''uo{s)ds. (3.6) 

^ — oo 

It has been proved in [3l Proposition 2.5] that the operator Q is an isometric 
isomorphism between X and X. This operator maps the initial value of the stochastic 
Volterra equation in the initial value of the abstract state equation. Different initial 
conditions of the Volterra equation generate different initial conditions of the state 
equation. 

Hypothesis 12.21 is necessary in order to have a greater regularity on the inial value 
of the state equation. In fact in this case [3J Proposition 2.20]) shows that Quq belongs 
to X^ for rj G (0, i). 

Remark 3.3. We stress that under our assumptions we are able to treat, for 
instance, initial conditions for the Volterra equation of the following form 



Uo{t) 



0, (-oo,-(5); 
u [-S, 0] 



provided u has a suitable regularity. 

We quote from [3j the main result concerning the state space setting for stochastic 
Volterra equations in infinite dimensions. 

Theorem 3.4 (State space setting). Let A, a, a{a), W be given above; choose 
numbers rj G (0, 1), 6 G (0, 1) such that 

^>^(1 -«(«)), e<]^{l + a{a)), 0-V>\- (3.7) 

Then there exist 

1) a separable Hilbert space X and an isometric isomorphism Q : X ~> X, 

2) a densely defined sectorial operator B : D{B) <Z X ^ X generating an 
analytic semigroup e*^ with growth bound wq,- 

3) its real interpolation spaces Xp = {X, D[B))(^p 2) with their norms \\ ■ \\p, 
4-) linear operators P : H ^ Xg, J : X^/ — ^ H 

such that the following holds: 

For each Xq X , the problem \3.2\) is equivalent to the evolution equation 



x'(i) = i?x(t) + (/ - B)Pf{t) 

X(0) = Xq 

in the sense that if uq G Xq and x(t; a;o) is the weak solution to Problem (13. 8p with 
Xq — Quq, then u(t;uo) = Jx(t;xo) is the unique weak solution to Problem (13. 2p . 

It is remarkable that B generates an analytic semigroup, since in this case we 
have at our disposal a powerful theory of optimal regularity results. In particular. 
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besides the interpolation spaces Xg introduced in Theorem 13.41 we may construct the 
extrapolation space i.e., a Sobolev space of negative order associated to e*^. 

Assume for simplicity that B is of negative type (otherwise, one may consider 
B — luq instead of B in the following discussion). The semigroup e*^ extends to X_i 
and the generator of this extension, that we denote is the unique continuous 

extension of B to an isometry between X and See for instance [15l Definition 

5.4] for further details. 

Remark 3.5. In the sequel, we shall always denote the operator with the letter 
B, even in case where formally B^i should be used instead. This should cause no 
confusion, due to the similarity of the operators. 

4. The state equation: existence and uniqueness. In this section, moti- 
vated by the construction in Section [3J we shall establish existence and uniqueness 
result for the following stochastic controlled Cauchy problem on the space X defined 
in Section [3l 

dx{t) = Bx{t)dt + {I - B)Pf{t, Jx(t))dt+ 

(/ - B)Pr{t, Jx(i), j{t))dt + B)PgdWit) (4.1) 

x(s) = X. 

for < s < t < T and initial condition x G X^. The above expression is only formal 
since the coefficients do not belong to the state space; however, we can give a meaning 
to the mild form of the equation: 

Definition 4.1. We say that a continuous, X -valued, predictable process x = 
(x(t))t>o is a (mild) solution of the state equation (|4.ip ifF-a.s., 

x(t) = e^*-'')^^ + / e(*-'^)^(/ - B)Pf{a, Jx(a))da 

J S 

^ lo + / e'^'-''^^(I - B)PgdWia). 

Let us state the main existence result for the solution of equation (|4.ip . 

Theorem 4.2. Under Hvvothesis \2.1\. \ 2.'A for an arbitrary predictable process 7 
with values in U, for every < s < t < T and x 6 Xj^, there exists a unique adapted 
process x G L^{fl,C{[s,T]; X^j)) solution of (|4.ip . Moreover, the estimate 

E sup ||x(i)||^<C(l + |H|^) (4.2) 
te[s,T] 

holds for some positive constant C depending on T and the parameters of the problem. 

Proof. The proof of the above theorem proceeds, basically, on the same lines 
as the proof of Theorem 3.2 in Bonaccorsi and Mastrogiacomo [4 (2009). First, we 
define a mapping fC from U'{Q,\C{[Q, T]; X^)) to itself by the formula 



/C(x)(t) := e(*-^)^x + A(x)(0 + A(x)(t) + Tit), 



(4.3) 
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where the second, third and last term in the right side of (|4.3p are given by 

A(x)(t) = J' e(*-^)^(/ - B)Pf{T, Jx(r))dr (4.4) 

A(x)(t)==^ eS'-^'l^il - B)Pgr{T,J^{T),j{T))dT (4.5) 

T{t) = f eS*-^^^{I - B)Pg AW{t) (4.6) 

J s 

Then, we will prove that the mapping is a contraction on LP{VI\ C([0, T] \ Xjj)) with 
respect to the equivalent norm 

l>c%:=E sup e-^P'Mt)\\P, 

t£[0,T] 

where /3 > will be chosen later. For scmplicity we fix the initial time s — and 
write A{t) instead of A(x)(t). 

Our first step is to prove that T, A and A are well-defined mappings on the space 
LP{^; C([0, T]; Xjj)) and to give estimates on their norm. We choose 6 small enough 
such that l + r]-9 + l/p<S«l/2 and define 

Vnir) ■■= [\t-ar'eS*-^^^{I-BfPgdW{a). 
Jo 

Since the semigroup e*^ is analytic, P maps H into Xg and g G ^2(2, H), an applica- 
tion of Lemma 7.2 in [29], yields: E \yjj{a)\P < 00. In particular y e L^([0, T];X), 
P-a.s. Moroever, if we set 

{Rsm) = f\t - a)*'-ie(*-^)^(/ - By+^-'^{a)da, 
Jo 

then in |121 Proposition A. 1.1.] it is proved that Rs is a bounded linear operator from 
LP{[0,T];X) into C{[0,T];X). Finally, by stochastic Fubini-Tonelh Theorem we can 
rewrite: 



JO 



{I - B)'^+^e^'^-''^^PgdW{a) dr 
(1 - T^-'^T-^dT] {I - s)"r(<) 



and conclude that r{t) £ LP{n,C{[0,T]; X^j)). 

In a similar (and easier) way it is possible to show that A(-,t) and A(-,t) belong 
to LP{n,C{[0,T];Xr,)). Finally, we conclude that JC maps £^(0; C([0, T]; X^)) into 
itself; to this end it is sufficient to recall that the initial condition x belongs to X,,; 
but this follows immediately from the analiticity of the semigroup, provided that e*^ 
is extended to a constant for t < s: 

e(t-^)B^ ^ x for t < s. 
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Now we claim that /C is a contraction in L^(ri, C([0, T]\ X^)). In fact, by straight- 
forward estimates we can write 

m^){t) K{y){t)\% < C7i^T/3^/'+'-('-'')|N - y\l. 

Therefore /C is Lipschitz continuous from L'P{il,C{[0,T];Xrf)) into itself; further, we 
can find /3 large enough such that Cl_t(2/3)^^^^''^''~^ < 1. Hence K. becomes a 
contraction on the time interval [0, T] and by a classical fixed point argument we get 
that there exists a unique solution of the equation (|4.ip on [0,T]. □ 

Remark 4.3. In the following it will be also useful to consider the uncontrolled 
version of equation (14. ip . namely: 

('dx(t) = Bx{t)dt + (/ - B)Pf{t, Jx(t))dt + (/ - B)Pg dW{t) 

\x(0) =x. ^ ' ' 

We will refer to (|4.7p as the forward equation. We then notice that existence and 
uniqueness for the above equation can be treated in an identical way as in the proof of 
Theorem f 



5. The controlled stochastic Volterra equation. As a preliminary step for 
the sequel, we state two results of existence and uniqueness for (a special case of) the 
original Volterra equation. The proofs can be found in [?, Section 2]. 

Proposition 5.1. The linear equation 

d /■* 

-/ ait-s)u{s)ds^Auit), te[0,T] 

dt J_oo (5.1) 

u{t) =0, t<0. 

has a unique solution u = 0. 

Now we deal with existence and uniqueness of the Stochastic Volterra equation 
with non-homogeneous terms. To this end we extend the result in [51 Theorem 3.7] 
where the case f{t) = is treated. 

Proposition 5.2. In our assumptions, let xq g V^ for some < r] < 

■ha{a). Given the process 



x(i) = e*^xo+/ e^*''^^{I-B)Pf{s)ds+ f e^*-'^^ {I - B)Pg dW{s) 
Jo Jo 

we define the process 



(5.2) 



(5.3) 

\uoit), t<0. 
Then u(t) is a weak solution to problem 

^ f a{t-s)u{s)ds^Au{t) + f{t)+gW{t), t e [0,T] 

dt J_oo (5.4) 

u{t)=uo{t), t<0. 
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After the preparatory results stated above, here we prove that main resuft of 
existence and uniqueness of solutions of the original controlled Voherra equation (|l.ip . 

Theorem 5.3. Assume Hvvothesis \2.1\ and \2.2[ Let ^ be an admissible control 
and X be the solution to problem U.3\) ) (associated with "f) whose existence is proved 
in Theorem\4-.2\ Then the process 



u{t) 



_ juoit), t < 



\jx{t), te[0,T] 

is the unique solution of the stochastic Volterra equation 



- ait- s)u{s) ds = Au{t) + fit, nit)) + g r(t, uit), -fit)) + Wit) 
at 7-00 L 

M(i)=ito(i), t<0. 



(5.5) 



t€[0,T] 



(5.6) 



Proof. We propose to fulfiU the following steps: first, we prove that the afHne 
equation 



dt 



ait - s)m(s) ds = Auit) + fit, uit)) + g r(t, -fit), uit)) + Wit) 
uit)^uoit), t<0. 



tG[0,T] 



(5.7) 



defines a contraction mapping Q : u n- u on the space L'^i^; C([0, T]; H)). Therefore, 
equation l|5.7p admits a unique solution. 

Then we show that the process u defined in (|5.5I) satisfies equation (15. 7p . Accord- 
ingly, by the uniqueness of the solution, the thesis of the theorem follows. 

First step. We proceed to define the mapping 

Q : LPin- Ci[0, T];H)) ^ (f!; C([0, T]; H)) 
where Qiu) = u is the solution of the problem 



— / ait - s)uis)ds ^ Auit) + git, uit)) r(t, u(<), 7(t)) + VF(t) 



uit) = uoit), 



t < 0. 



te[0,T] 



(5.8) 



It follows from the uniqueness of the solution, proved in Proposition [5TT1 that the 
solution Uiit) (i — 1,2) has the representation 



Uiit) 



Mit), te[0,T] 

Uoit), t < 



where 



Viit) = e^^vo + 



e(*-«)B(/ _ B)Pgis, Ms))ris, Ms), 7(5)) ds 

e^^-'^^il - B)Pgis,Us))dWis). 
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In particular, 



U{t)=Ui{t)-U2{t) = 



J{vi{t)-V2{t)), ie[0,T] 
0, < < 0; 



E sup e-PP'\U{t)\P <\\J\\l sup e-^P'\\vr{t) - V2[t)r^ 

tG[0,T] ^ ' te[o,T] 



then 



the quantity on the right hand side can be treated as in Theorem 14.21 and the claim 
follows. 

Second step 

It follows from the previous step that there exists at most a unique solution u of 
problem (j5.7p : hence it only remains to prove the representation formula (|5.5p for u. 

Let f{t) = f{t,Jx{t)) + gr{t, Jx{t),'-f{t)); it is a consequence of Proposition 15.21 
that u, defined in (j5.5l) . is a weak solution of the problem 



d r ~ . 

-J a{t- s)u{s) ds = Auit) + }{t) + gW{t), 
u{t)^uo{t), t < 0, 
and the definition of / implies that u is a weak solution of 



t e [0,T] 



(5.9) 



— / a{t- s)u{s) ds = Au{t) + f{t, Jx(i)) + g r{t, Jx(i), 7(t)) + W{t) 

u{t) Mo(i), 



t £ [0,T] 

t < 0, 

(5.10) 

that is problem ()5.7p . □ 

6. The forward SDE. In the following we are concerned with smoothness prop- 
erties of the forward equation, i.e. of the uncontrolled state equation (|4.7p on the time 
interval [s,T] with initial condition x G X^. It will be denoted by x(t; s,x), to stress 
dependence on the initial data t and x. Also, we extend x(-; s, x) letting x(i; s,x) = x 
for t G [0, s]. 

Before proceeding with the program mentioned above, we list relevant properties 
of the nonlinear term of the reformulated equation. 

Remark 6.1. It follows directly by the properties of the nonlinear mapping f 
and the operator J that, under Hypothesis \2.1\ the function {t, x) n- /(i, Jx) from 
[0,r] X into H is measurable and it verifies the following estimates 

\fit,Jx)~f{t,Jy)\H<L\\J\\^x,-H)\\x~y\U ie[0,T], x,y e X^; 
\f{t,JO)\<C, ie[0,T]. 

Moreover, for every t G [0,T], {t,x) f{t,J{-)) has a Gateaux derivative at every 
point X G Xri-' this is given by the linear operator on X^i 

V^{f{t,Jx))[h]^Vuf{t,Jx)[Jh]. 

Finally, the function {x,h) — )■ \7 f{t, Jx)[h] is continuous 

J3:)||^ < C; for t G [0,T], x G and a suitable constant C > 0. 
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Now we consider the dependence of the process (x(t; s, x))t>o on the initial data. 
More precisely, we prove that (x(i; s, a;))t>o depends continuously on s and x and it is 
also Gateaux differentiable with respect to x. The following result rely on Proposition 
2.4 in Fuhrman and Tessitore |21j . where a parameter depending contraction principle 
is provided. 

Proposition 6.2. For any p > 1 the following holds. 

1. The map (s, x) i— > x(t; s, x) defined on [0, T] xXrj and with values in LP{Q, C([0, T]; Xrj)) 
is continuous. 

2. For every s € [0,T] the map x t-^ x(t; s, a;) has, at every point x G Xr^, 
a Gateaux derivative s, x) . The map {s,x,h) i— )■ Va;x(-; s, is a 
continuous map from [0, T] x x X,, — !■ L^lfl, C([0, T]; X^)) and, for every 
h 6 X,,, the following equation holds P-a.s.; 

V^K{t;s,x)[h] = e(*-'')^/i+ 

e(*--)B(/ _ B)P V„/(t, Jx(t; s, a:)) JV,x(t; s, x)[/i]dT, 



/or an?/ t S whereas Vxx(i; s, a;)[/i] = /i /or t G [0, s]. 

Proof. Point 1: continuity. As before, we deal with the mapping r,A and JC 
defined in (|4.3p . (|4.4p . (|4.6I) and we wiU denote F, A and K. respectively by r(x;s), 
A(-; s) and A^(x; s, x) in order to stress the dependence on the initial conditions s and 
X. Moreover we set /C(x; s, a:) = x, r(x; s) = and A(- -,3) — ior t < s and we recall 
that /C(-; s,x) is a contraction, with contraction constant independent on s and a;, in 
the space LP{fl,C{[0,T];X,i)) wih respect to the norm 

|Wi;:=E sup e-^*||x(i)||?;. 

*6[0,T] 

By a parameter dependent contraction argument (see, for instance [3T1 Proposi- 
tion 2.4], the claim follows if we show that for all x G L^'(r2, C([0, T]; X^)) the map 
1 1— > /C(x; s, x) is a continuous map from [0, T] x with values in L^(r2, C([0, T]; X^)). 

To this end, we introduce two sequences {s^} and {s~} such that s+ \ s 
and s,^ s and we estimate the norm of /C(x;s^,x) — /C(x;s^,a;) in the space 
L?'(r2,C([0,T];X^)). We have 

lfC{K;s+,x)-IC{^;s-,x)%< sup ||e(*-^")^x - e^*"^- 

*6[0,T] 

+ sup \\A{^;st){t)~A{x;s-){t)\\P+ sup ||r(t; 4) - r(t; s") Hj;. 

te[o,T] te[o,T] 

Now we focus on the third member of the above inequality: introducing a change 
of variables we obtain 



E sup \\r{t;s+)~r{t;s-)\\P<E sup 
*e[o,T] te[s-,T] 



/tAs+ 
e(*-")^(/-B)F5dVF(T) 



<E sup \\rit;s~)\\l 
*e[s„ ,s+] 

<E sup ||r(t;0)||^^0, 

ie[0,s+-s„] 
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where the final convergence comes as an immediate consequence of the dominated 
theorem, since r(-;0) G LP{n,C{[0,T]- X,^)). Similarly, 

E sup ||A(x;4)(i)-A(x;s-)(t)r 

te[o,T] ' 

c + 



< E sup 

te[s-,T] 

< E sup 



{I-B)Pfir, Jx(T))dT 



{i-Br+^pf{T,jK{T)) 



< 



Cl.tE sup (l + ||x(r)||P) sup ( f (t-T)" 



dr 



-"-Ml 



n n 



0. 



Finally, if we extend e^* '^^'^ to the identity for t < s we have 



sup 

te[o,T] 



sup 

te[s;r,T] 







and also the map x i— > {i i— > e'*^''-'^a;} is clearly continuous in x uniformly in s from 
Xjj into the space C([0,T];X^). 

Point 2: differentiability. Again by [21] Proposition 2.4], it is enough to show that 
the map (x, s, x) i~> /C(x; s, a;) defined on LP(fi, C([0, T]; X^)) x [0, T] x with values 
in LP{n, C([0, T]; Xjj)) is Gateaux differentiable in (x, a;) and has strongly continuous 
derivatives. 

The directional derivative Vx/C(x;s,x) in the direction h e LP{i},C{[0,H];Xrj)) 
is defined as 



lim 

6^0 



/C(x + erh; s, a;) — /C(x; s, a;) 



We claim that the above limit coincides with the process 

Vx/C(x;s,x)[h](t) = ^ e(*--)^(/ - B)PV„/(t, Jx(r))[Jh(T)]dT, t £ [s,r], 

whereas Vx/C(x; s, a;)[h](t) = when t < s. Moreover, the mappings (x; s, a;) i— >• 
Vx/C(x;s,a;) and h VxA^(x; s, a;)[h] are continuous. In fact, let us define the 
process 



Pit) 



lC{x + eh; s, x){t) — /C(x; s, x){t) 



- f e(*--)^(/ - B)PV^f{T, Jx(r))[Jh(T)]dr; 

J s 

which, since we have the identity 



s Jo 



e(t-r)B(j _ B)PV„/(t, , Jx(t) + e ^ Jh(T))[Jh(T)]de dr 



l_d 

f^d^ 



,(t-r)i3 



(/-i3)P/(T,Jx(r)+eC^h(T)), 
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can be rewritten as 

r{t) = J* dr e(*-^)^(/ - B)PVuf{T, Jx{t) + e UHr))[Jh{T)] 
_e(*--)S(/ _ B)Py^f{T, Jx(t)) J[h](T)de ' 



Moreover by the assumption on the gradient of /, for ah e > we have 



E sup 

t6[s,T] 



dr 



{I - B)P\7uf{T, Jx(t) + e e Jh(T)) [h(T)]de 



<\\^uf\nP\\l,H.^M sup /*dr||e(*-)^(/-i3 

^ ' ' tels.T] Js 



te[s,T] 



< oo 



and e'*~'^''^(/ — V„/(r, Jx) J is continuous in x. Therefore, by the dominated 
convergence theorem, we get — > 0, as e — >■ and the claim follows. Continuity 
of the mappings (x, s, a;) Vx/C(x; s, a;)[h] and h n> Vx/C(x; s, x)[h] can be proved 
in a similar way. 

Finally, we consider the differentiability of A^(x; s, a;) with respect to x. It is clear 
that the directional derivative S/xf^i^] s,x)[h] in the direction h £ X.^, is the process 
given by 

V^/C(x;s,x)[/i] =e(*-")^/i, iG[s,T], 

whereas V2;/C(x; s, — h for t e [0,s] and the continuity of Vj;AI^(x; s, in all 

variables is immediate. 

□ 

In the rest of the section we introduce an auxiliary process that will turn to be 
useful when dealing with the formulation of the fundamental relation for the value 
function of our control problem. More precisely, for any x € Xq and t £ [0,r] and h 
in the space 

V := {h e Xi-e ^ X : {I - B)^-% e X,^} , (6.1) 

we define the process (B(i; s, x)[/i])tg[o j-j as 

e{t;s,x)[h]:={VMt;s,x)-e^'-''>^){I-B)^-''h, fortG[s,r] (6.2) 

and Q{t; s,x)[h] := whenever t G [0,s). We notice that Q{-;s,x) can be seen as a 
stochastic process with values into the space of linear mappings on V. In the following 
we shall prove that it can be continuously extended to the whole space X (that with 
an abuse of notation we still denote by 8). To this end, the first step is to verify that 
the domain 2? is dense in X. 

Proposition 6.3. The space V defined m (|6.ip is dense in X. 

Proof. We recall that the linear operator B is densely defined (see Theorem p.4p ') 
and that D{B) is contained in all real interpolation spaces Xp, p e (0, 1). We notice 
that if /i G D{B) we have 



\\{I-By-%\\r, = \\iI-Br-'^+^h\\x<^. 
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This implies that D{B) C V so that the claim follows. □ 

Now we are ready to prove that Q(t;s^x) can be extended as a linear operator 
from X into itself. 

Proposition 6.4. There exists a process {&{■ ;s,x)[h] : h e X; x e Xn, s e [0,r]} 
defined on D, x [0,T] — > Xri such that the following hold: 

1. The map /i i— > 0( • ;s,x)[h] is linear and, on the space T> C X, has the 
representation given in (|6.2p .' 

2. The map {s,x,h) ^ Q{ ■ ;s,x)[h] is continuous from [0,T] x X,, x X into 
L-(f7;C([0,T];X,)); 

3. There exists a positive constant C such that 

|e( • ;s,a:)[ft.]|L~(O;C([0,T];X,)) < C\h\x, (6.3) 
for all s € [0, T], x e X,,, heX. 

Proof. For fixed s S [0,T], a; 6 X^-^ and h E H we consider the integral equation 
Q{t;s,x)[h] = I e'^^-'^^^il - B)PVuf{a,Jx{a;s,x))je{a:s,x)[h]da 

J S 

+ ^* e(*-")^(/ - B)PVuf{o, Ma; s, x))J{I - B^-'' e^^-'^^ hda. (6.4) 

Notice that 



dcr 



I e(*^")^(/ - B)PVuf{a, Jx((t; s, x))J{I - B)^-'> e^"-'^^ h 

J S 

< ^ ||e(*-'^)^(/-S)|U(^,;^)||P|U(ff;X.)||V,J(a,Jx(a;5,x))|U(ff) 

\\J\\cix,;H)\\{I B^-'^eS'^-^^^U^x-.xJhlxda 

< C\h\x Jjt^ af-\a - sf-^-'^da 

< C\h\x(t - 3^-"^+^ [\l - a)"- V-i-^da 

Jo 

= C\h\xBid-r,,9) 

where B{a,/3) is the beta-distribution of parameter a,/3 > 0. By the above es- 
timate we then obtain that equation (16.41) has P-almost surely a unique mild so- 
lution in C{[s,T];Xrf). Moreover, extending Q{t;s,x)[h] — 0, for i < s, we have 
ei-,t,x)[h] e i-(l];C([0,T];X^)) and M-, s, x)\L^^n-cilo.nx,)) < C\h\x. Con- 
cerning the continuity with respect to s, x and h, we can argue as in the proof of 
Proposition [621 Moreover, linearity is straight - forward. 

Finally, we prove the representation formula (|6.2p for s,x)[k] when k £ V. 
Setting h — {I — B)^^^k, the equation satisfied by the Gateaux derivative of x(-; s, x) 
at h is given by 

(V,x(t;s,a;)-e(*-^)^)(/-B)i-^[fc] = 

f e(*-^)^(/ - B)P V,/(t, Jx(r; s, x)) JV,x(t; s, x){I - B)i-^[fc]dT, 

J S 
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and by adding and subtracting the term e'-'^ *)^(/ — B)^ ^[k] suitably in the integral 
of the above inequality we obtain 

(V,x(i;s,x)-e(*-^)^)(/-i3)i-«[A:] 
t 

^(t-r)B^j _ B)p\jj[t, Jk{t; s, x))Je^^-''>^{I - By-<^[k]dT 
+ f e(*-^)^(/ - B)P Vuf{T, Jx(t; s, x)) J[V,x(r; s, x) - e(^-^)^](/ - B)^-'[k]dT. 

J s 

Comparing the above equality with the equation satisfied by s,x)[k] and apply- 
ing Gronwall's lemma we conlcude that s, x)[k] = {Vx^{t;s,x) — e''^^*-'^)(/ — 
S)i-^[fc], P-a.s. for all t e [s,T]. 
□ 

6.1. Regularity in the sense of Malliavin. In order to state the main re- 
sults concerning the Malliavin regularity of the process x we need to recall some basic 
definitions from the Mlliavin calculus. We refer the reader the book [33 for a de- 
tailed exposition. The paper [23 treats the extension to Hilbert space valued random 
variables and processes. For every h e L^(0,T;S) we denote by W{h) the integral 
/q {h{t),dW{t))s. Given a Hilbert space K, let us denote by Sk the set of if-valued 
random variables F of the form 

m 

F = Y,f,{W{h^),...,W{K))e„ 

where /ii,...,/i„ e L-^(0,r;S), {cj} is a basis of K and are infinitely 

differentiable functions M" — > M bounded together with all their derivatives. The 
Malliavin derivative DF of F G Sk is defined as the process D^F, a £ [0,T], 

m n 

D,F = 5m . . . , W{K))e, ® hk{s), 

j=i k=i 

with values in L2{'B.,K); by dk we denote the partial derivatives with respect to the 
k-th variable and by ej (8i hk{s) the operator u ej{hk{s),u)E- It is known that the 
operator D : Sr C L^(Q.;K) -> L'^[n x [0, T]; i2(S; if )) is closable. We denote by 
'&--'^{K) the domain of its closure, and use the same letter to denote D and its closure: 

D : B^-^{K) C L^{n;K) ^ L^{n x [0,T]; L2{E; K)). 

The adjoint operator of D, 

S: doni{S) C L'^{nx[0,T];L2{E;K)) L^{n;K), 

is called Skorohod integral. It is known that dom((5) contains Ljr{il x [0, T]; L2(S; K)) 
and the Skorohod integral of a process in this space coincides with the Ito integral; 
dom((5) also contains the class L^'^(L2(S; if)), the latter being defined as the space 
of processes u e L'^{n x [0, T]; ^2(2; if)) such that u{t) e ©1^2(^2(2; if )) for a.e. 
t G [0, T] and there exists a measurable version D^u{t) satisfying 

\W\\h.^{L2{S-K)) = ll"lli2(nx[0,T];L2(H;-ftr)) 

+ E [ [ li?au(t)|i^(3.i^(3.^))dtda<oo. 
Jo Jo 
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Moreover, < 

The definition of h^''^{K) for an arbitrary Hilbert space K is entirely analogous. 

We recall that if e I}^-'^{K) is J't-adapted then DF ^0 a.s. on 17 x {t,T]. 

Now let us consider again the process x = {^{t; s,x))t^[s x]i denoted simply by 
x(t), solution of the forward equation (j4.ip . with s e [0,T], x G fixed. We set as 
before x(t) = x tor t € [0, s). We will soon prove that x e L^'^(X^). Then it is clear 
that the equality Da-:>c{t) = 0, holds, P-a.s., for a. a. a, s,t ii t < s oi a > t. 

Proposition 6.5. Assume Hypothesis \2J\ Let s G [0,T] and x e Xj, be fixed. 
Then the following properties hold: 
J. X e Li'2(X„); 

2. For a. a. a and t such that s < a <t <T , we have P-a.s. 

D,^{t) = (/ - B)e(*-")^P g+ 

I e'^^-'^^^'il - B)PVufir,Mr))JD,^{r)dr. (6.5) 

and 

P.x(i)|U,(H,^,) < C\{t - a)'-^-^ + 1], (6.6) 

from which it follows that for every tc^ [0,T] we have D'x.{t) G L°°(r2; L^(0, T; i2(2, X^))). 

3. There exists a version of Dn such that for every a G [0, T), {Dcr:x.{t) : i G (cr, T]} 
is a predictable process in L2(S;X^) with continuous path, satisfying, for 

p G [2,oo), 

sup Ef sup it~ay(o-'-^mDMt)r ] <C, (6.7) 

for some positive constantC depending only onp,L,T and M := sup^^jQ^j k*^!- 
Further, for every t G [0,r] we have x(t) G D^''^{Xn). 
4- For every q G [2,oo), the map t DTi(t) is continuous from [0,T] (hence 
uniformly continuous and bounded) with values in LP{fl; L'^{[0, T]; ^2(2; X^i)). 
In order to prove this proposition we need some preparation. We start with the 
following lemma. 

Lemma 6.6. //x G L^'^(X^) then the random processes 

^(t-r)B ^ J _ ^(^^ Jx(r))dr and / e^*"'') (/ - B)PgdW{r) 

Jo 

belong to L^'^(X^) and for a. a. a and t with a < t, 

D„ [ e(*"'')^(/ - B)P f{r, Jx(r))dr = 
Jo 

I {I- B)P\7uf{r, Mr))JD,x{r)dr (6.8) 

while 

Da I e(*-'')^(/ - B)PgdW{r) = e^'-''^^{I - B)Pg (6.9) 
Jo 
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Proof. Wc start by proving that the process 



lit) 



.{t-r)B(r _ 



{I - B)Pf{r, Jx(r))dr 



belong to L^'^(X^) and that equahty (|6.8|) hold. By definition, we need to prove that 
for a.e. t e [0,r], the random variable I{t) belong to ©^'^(X^) with 

2 



E 



ff 


f 


10 Jo 


Jo 



,{t^r)B(j _ 



[I - B)Pf{r, Jx(r))d7 



dr da < oo. 



(6.10) 



i2(H;H) 



To prove (|6.8p we will use the relation between the Malliavin derivative and the 
Skorohod integral. In particular, we recall that D^'^(X^) — dom{S*) where 6^ is the 
adjoint of the Skorohod integral. Hence, (|6.8p will be proved once we will have shown 
that, for any y e L^(ri x [0,r];X^) the equality 



( / e(*-'^)^(/ - B)Pf{r, Jx(r))dr, S{y))mn;X,) 
Jo 

= { I e^'^^^^I - B)PD.fir,Mr))dr,y)L2^nxlo.T]-x,) 
Jo 

holds. For fixed y G dom((5) we consider the scalar product between I{t) and S(y) in 
the space applying Fubini's theorem we have 

{I{t),S{y))L^n;X,-,^E{I{t),S{y))r, 

5(e(*-'-)S(/ _ B)Pfir, Jx(r)), 5(y))„ dr 

= / (e('-'^)^(/-i?)P/(r,Jx(r)),<5(y))i.(o^;,^) dr. 
Jo 

Now using the duality between the operators S and D we obtain 
(/(i),<5(y)}i.(0;x,) 

{D (e(*-^)^(/-i3)P/(r,Jx(r))),y)r.(Ox[o,T];L.(H,x,)) 

' (e(*-'-)^(/ - B)Pf{r, Jx(r))) , y)i,(H;X,)( 

E f if e(*-'-)^(/-B)Pi?,/(r, Jx(r))dr,y)da 
Jo Jo 

{T e^'--^^{I-B)PD.f{r, Jx(r))dr, y)i2(ox[o,T];X,) 



■idcrdr 



Comparing the first and the last term in the above expression we conclude that 

i{t) e 0^^^{x,^) with 

(5*/(t) = DI{t) ^ f e(*^'')-^(/ - B)PD.f{r, Jx(r))dr. 
Jo 



E 
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Now we prove estimate (I6.10p . First we notice that 

Jo Jo Jo 

< L'\\P\\l^H;Xs)^ f At-r)2(''-i-')(l + ||J|U(;,^^H)||x(r)||,)^drdt 



Jo 



The right-hand side is finite for a. a. t G [0,T]; in fact, by exchanging the integrals we 
verify that 

(^E^*(t-r)2(«-i-'')(l + |lJ|U(x,;if)||x(r)||,)2dr) dt 

< f r'^^'-'-'^^dr f ni + \\J\\L(X„.H)\\Ar)h?Ar 
Jo Jo 

since x e L^'^^^^) ^ L'^{nx[0, T];X^). Next, for every t £ [0, T], by the chain rule for 
Malliavin derivative (see Fuhrman and Tessitore [HI Lemma 3.4 (m)]), Dcr[f{r, Jx(r))] = 
V„/(r, Jx{r))JDax{r) for a. a. a > r, whereas Da[f{r, Jx(r))] — for a. a. cr > r, by 
adaptness. Next, recalling the assumption on Vu/, 

e[ [ P./(t)|lL(H.x,)did^ 



IQ JO 



<E f f f |le(*-'-)^(/ - i?)PV„/(r, Mr))JD„Mr)\\UE;X,)dr dt da 

Jo Jo Ja 

< l|V./||i(^) \\J\\lix,.M)\\P\\liH-,Xo)^ f r f\t-rf^'-'-'^\\Da^ir)\\li3.,xyr dt da, 

Jo Jo J a- 



so that, by an easy application of Fubini's theorem, 

pT pT 



Jo 



\\DaimUs;X,)dt da 
<CE f f f\t-rf^'-'-^^\\DMr)\\UE:X,)dr da dt 

Jo Jo Ja 

= CE f f r(i-r)2(«-i-'')p.x(r)||i^( )da dr dt 
Jo Jo Jo 

= C r f\t~rf^<^-^-^^ f nDMr)\\l,(^..x,,)d^ dr dt. 
Jo Jo Jo 

Now the right hand side of the previous inequality is finite; in fact, by exchanging the 
integrals we verify that 

(£(^-0'^"-'-"^ j^'EP.x(r)||i^(.^^^)da dr) dt 

< f r^i^-^-^) f r E\\DMr)\\U^.,x,)da dr dt 
Jo Jo Jo 

= ^'^^'^'^'"''^drj \\D.Al^^n.[o,T];L,i^;X,)) < 



22 



F. Confortola E. Mastrogiacomo 



since x e Li'2(X,,). This proves (pUJll . 

Now we consider the Mahiavin derivative of the stochastic term 

e^t-'-'^^il - B)PgdW{r) 

and we prove that it belongs to L-^'^(X^) and satisfies (|6.9p . This wih be consequence 
of an easy apphcation of the following fact, proved in [3T], Proposition 3.4: if y S 
L,'^''^{Xr,), and for a.a. a € [0,T] the process {D^y{t) : t e [0,T]} belongs to dom((5), 
and the map a 5{D„:>i) belongs to L'^{n x [0,r];X^), then 6{y) e Di'2(X,,) and 
DJiy)^y{<j)+S{D^y). 

We fix i G [0,T] and we define y(r) := e(*~'')^(/ - B)Pg ioi t > r and y(r) = 
0,t < r. Clearly y e L^'^(X^) and D^y = for every a e [0,T]. This implies 
that (-Dcry(0)t>o G dom((5) for a.a. ct G [0,T] and ct M' 5{Day) belongs to x 
[0,T];X^). On the other hand, we recall that the Skorohod and the Ito integral 
coincide for adapted integrand, so that 

6{y)= f e^'-'-^^il - B)PgdW{r). 
Jo 

Applying the result mentioned above we get 6{y) G L^'^(X,,) with 

^(y)= / e^'-''>^{I - B)PgdW{r) 
Jq 

= €^'-''^^{1 -B)Pg 

for a.a.t G [0,T] so that formula (|6.9I) is proved. 
□ 

Now for (7 G [0, T) and for arbitrary predictable processes {x{t))t^[rT.T] and (q(i))tg[(T,T] 
with values respectively in Xjj and L2(S;X^) we define the process H = 'H(x, q) as 

?^(x,q),i =e(*-^)^(/-B)P.g+ / e(*-'^)^(/ - B)PV„/(r, Jx(r)) Jq(r)dr. 
We are now ready to prove Proposition 16. 51 

Proof. [Proof of Proposition I6.5| We fix s G [0,T). Let us consider the sequence 
x" defined as follows: x" = G X,f, 

x"+i(t) = e(*-")^a;+ f e(*-'^)-^(/ - B)F/(r, Jx"(r))dr + / eS'-'^'>^ {I - B)PgdW{r) 

J S J S 

= /C(x")(t), 

and x"(i) — x for t < s, where the mapping /C was defined in Section |4] (see (|4.3p ). 
It was proved in Theorem 14.21 that /C is a contraction in Ljr{il;C{[0,T];X,i)), hence, 
in particular, in the space L^{il x [0,T]; Xjj). This implies that x" converges to an 
element x in this space. By Lemma |6^ x"+^ belongs to L^'^(X^) and, for a.a. a and 
t with a < t 

D^x"+i(t) = e'^'-'^l^il - B)Pg + j e^'-''^^ {I - B)PVuf{r, Jx"(r)) JD^x'^^dr. 

(6.11) 
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Hence, recalling the operator introduced above, we may write equality (|6.1ip as 

0^"+^ =7^(x",i:'x"). 

In the following we prove that 

||[«(x",i?x")|<a|px"|, 

for some a G [0, 1) and /3 > to be chosen later, where ||| • denotes an equivalent 
norm in L^(r2 x [0, T] x [0, T]; L2(S; Xn)). More precisely, for /? > 0, we introduce the 
norm 



ri := 



T rT 



"'0 



IErat|li,(S;X,)dtda. 



First we estimate the term U := {Uat : < ct < t < T} defined as Uat := €^^^"^^{1 
B)Pg. We have 



T rT 



P\%=l I 

J a Jo 



e ^ 

T rt 



:*-)||e(*--)^(/-i?)Pg||i^(.^^^)dt da 



Jo 

T rt 



= c. 



P.g 



where Cp,g is a positive constant depending only on the norms of P and g. Hence 
|e(t-<^)S(>_ 5)p^ : Q<a <t<T] is bounded in the space ^^(f^x [0, T] x [0, T]; L2(S; X^)). 
Now let us consider the norm of 7^(x", Dx"): taking into account the above inequality 
we get 



(x",i5x")|= r re-^(*--)E||-«(xM)x"U||i^(3^^^)dadt 
Jo Jo 



T pt ft 



E 



10 Jo Ja 

._ rj. r(2(e-i-r))) 



3(t-'-)S(/ _ B)PVuf{r, J^\r))JD,^''{r) 



dr dcr At 



we set i^(/3) := T „2(e-i-„)+i ■ Now changing the order of integration, we have 



rp T / T 



(< - r)-2(e-i-'7)e-/^(*-)dt 



-'^('•--'Ep.x"(r)||i^(.^;,^)drda 



T i-T 



sup 

J a \re[<j,T]Jr 



e-'^('^--)Ep.x"(r)||i^(^^;,^)drda, 
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where C'pjj is a positive constant depending only on the norms of P, f, J. Since the 
supremum on the right-hand side can be estimated by t2(«-i-'))e-'^*dt we obtain 

||[^(x",Z?x")|| < Cp^gHf3) + CpjMP) 

f f e-''('-'^)Ep,x"(r)||2 3^ drda. 

Jo J a 

Now we choose /3 large enough such that z^(/3)(l + ||px"|) < a||px"||, for a e [0, 1), 
so that the above inequality means that 

||^(x",i?x")|<aiPx"|, (6.12) 

with a e [0,1). From (pl^ and from the fact that €^^^"'^^{1 - B)Pg is bounded 
in L^(n X [0,T] X [0, T]; ^2(5; X^)), it follows that the sequence {_Dx"}^gpj is also 
bounded in this space. Since, as mentioned before x" converges to x in L^(r2 x 
[0, T]]X,-i) it follows from the closedness of the operator D that x belongs to L^'^(X,,). 
Thus point [1] of Proposition 16.51 is proved. 

We now consider point[2]in Proposition |631 First, we notice that, by Lemma [6^ 
we can compute the Malliavin derivative of both side of equation (|4.ip and we obtain, 
for a. a. a and t such that a <t the following equality P-a.s.: 

D,^{t) = eS'--'^^{I-B)Pg 

+ j e(*-'')^(/-B)PV„/(r, Jx(r))JL'^x(r)dr. (6.13) 

Since, for any a < t 

||e(*--)^(/-S)P.g|U,(H;x,) < {t-af-'-^^\\PU^H;X,ML.iE;X,), (6.14) 

by the boundedness of Vu/ and the Gronwall's lemma it easy to deduce that 

\\DMt)U,^^^x„)<Ciit-af-^-' + l). 

In particular it follows that, for every t e [0, T], the mapping a M- D^xit) is bounded 
inL-(r!,L2(o,r;L2(S;X^))). 

We now consider point [2] in Proposition 16.51 which concerned with the regular- 
ity of the trajectories of D^rX, a E [0,T). We introduce the space V of processes 
(qcrt)o<(T<t<Tj such that, for every a € [s,T), {(lat)te(a-,T] is a predictable process in 
Xjj with continuous paths, and such that 

sup e( sup e-^(*-'^)P(i-a)P(''-i-'')||q,,||i^(S;X,) ) < oo. 

a€[O.T] \teis,T] ^ J 

Here p G [2, oo) is fixed and /? > is a parameter to be chosen later. Let us consider 
the equation 

ciat = e(*-'^)^(/ - B)Pg + f e(*-'-)^(/ - B)PVuf{r, Jx(r)) Jq^.dr, (6.15) 

J a 

which we can rewrite as 

q^t = 'H(x,q)^t, t e ((T,T]. 
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We claim that equation (I6.15P admits a unique mild solution in the space V. To prove 
this, it is suffices to show that the term {U„t)o<cr<t<T defined before belongs to V and 
that H is a contraction in the space V. Since, for any a < t 



||e(*--)^(/-i?)Pg|U,(H;x,)<(t-a)<'-^-"'||P||L(H;X.)||5lU.(H;X,) 



we have 



sup sup {t - a)f(i+"-'^)||e(*-^)^(/ - i?)Pg|U,(H.x,) < oo. 

<Te[0,T] t£(a,T] 

This proves that L/ £ V. Further, repeating almost identical passages as those leading 
to (|6.1ip . we can prove that ■H(x, •) is a contraction in the space V provided that /? is 
chosen sufficiently large. This proves the claim. 

Now we prove that q is the required version of Dx. Subtracting (I6.15P from 
(|6.13p . we obtain, P-a.s., for a. a. a and t with a < t 

D^xit) - q^t = I e(*-'^)^(/ - B)PVuf{r, Mr)) [J{DMr) - q.r)] dr. 

J CT 

Repeating the passages that led to (|6.12p . we obtain 

llp.x - q||| < allp.x - q|| 

for some a < 1, which clearly implies that q is a version of I?x. 

To conclude the proof of [3] in Proposition 16.51 we need to prove that x(i) G 
D^'^(X^) for every t G [0,r]. This assertion is clear for t G [0,s] since x{t) = x for 
t < s. For t G {s,T] we take a sequence tn \ t such that x(t„) G ©^^^(X^) and we 
note that by (|6.7p . the sequence 



Jo 



lL(H;X,)da 



is bounded by a constant independent of n. Since x(t„) — > x(t) in i^(r2;X^), it 
follows from the closedness of the operator D that x G D^'^(X^). 

Now we prove point |4] in Proposition [6?5j To prove that 1 1— > Dyi{t) is continuous 
as a mapping from [0, T] into L^{0, T; X,,)) we fix i G [0, T] and let t+ \ t and 

Z' t. Then, since Dx satisfies equation (|6.15p . we have 



E 



\DMti) - D,x{t-)\\i^Aa < 2 / (e^*-''^)^ ~ e(*"-'^)^)(/ - B)Pg 

i-T 



da 



2E 



{I - B)PVuf{r, Jx(r)) JD,x(r)dr 



.it--r)B 



{I - B)PVufir, Jx{r))JDMr)dr 



(6.16) 



We estimate the two terms in the right member of the above inequality separately. 
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Concerning the first one, which is deterministict we have 



'){I-B)Pg 



(I - B)Pg 



2 




da + 


f 




Jo 



da 



(e(*i-*;:)s_/)e(*"-)^(/-S)F5 



da 



< C 



■(4-a)2(«-"-i)da + Cp,3||e(*"-*")^-/f / " {t;, - af^'-'-'^^da 



P,9 



We notice that both integrals in the last part of the above expression go to as 
n — > oo. 

In a similar way, using the bound (|6.7p on L'fjX for p =^ oo, we conclude that also 
the second integral in (16.16^ goes to and the required continuity follows. 



Now we denote by {ej}j^f^ a basis on the space :i and consider the standard real 



Wiener process (t) = Jrp{ej,W{s))ds. We conclude the section by investigating 
the existence of the joint quadratic variation of ,i € N with a process of the 
form {■w{t,x{t)) : t ^ [0,T]} for a given function w : [0,T] x X ^ M., on an interval 
[0, s] C [0,r). As usual this is defined as the limit in probability of 



where {t; : = tg < < ■ • • < i = 0, . . . ,n} is an arbitrary subdivision of [0, t] 
whose mesh tends to 0. We do not require that convergence takes place uniformly in 
time. This definition is easily adapted to arbitrary interval of the form [s, t] C [0, T). 
Existence of the joint quadratic variation is not trivial. Indeed, due to the occurrence 
of convolution type integrals in the definition of mild solution, it is not obvious that 
the process x i a semimartingale. Moreover, even in this case, the process x) might 
fail to be a semimartingale if w is not twice differentiable, since Ito formula does not 
apply. Nevertheless, the following result hold true. Its proof could be deduced from 
generalization of some result obtained in jl3[ pg. 193] to the infinite-dimensional case, 
but we prefer to give a simpler direct proof. 

Proposition 6.7. Suppose that w e C([0,T) x X^;M) is Gateaux differentiable 
with respect to x, and that for every s < T there exist constant K and m (possibly 
depending on s) such that 

\w{t,x)\ <K {I + 1x1)"", \Vw{t,x)\ < K{l + \x\r, te[0,s],xeX. (6.17) 



Let rj and 9 satisfy condition (|3.7p in Theorem \3.4\ Assume that for every t G [0,T), 
x € X^i the linear operator k h-> 'SIw{t,x){I — By^^k (a priori defined for k € T>) 
has an extension to a bounded linear operator X — > M, that we denote by [Vw{I — 
B)^^^]{t,x). Moreover, assume that the map {t,x,k) ^ \S/w{I — BY^^]{t,x)k is 
continuous from [0, T)xXr^xX into M. Fort S [Q,T),x & X^, let {x(t; s,x),t G [s,T]} 
be the solution of equation (|4.7p . Then the process {w{t,:x.(t; s,x)),t G [s,T]} admits 
a joint quadratic variation process with , for every j S N, on every interval [s,t] C 
[s,T), given by 

[yw{I - B)^-\r, x(r; s, x)){I - BfPgcjdr. 
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Proof. For semplicity we write the proof for the case s = and we write 
x(i) = x(i; s, x), w(t) = w{t, x(t)). It follows from the assumptions that the mapping 
{t,x,h) \7w{t,x)h is continuous on [0,T) x x X. By the chain rule for the 
Malliavin derivative operator (see Fuhrman and Tessitore [21]), it follows that for 
every t < T we have w(t) G ]D)'^^'^{X,j) and Dw{t,x{t))Dx{t). 

Let us now compute the joint quadratic variation of w and on a fixed interval 
[0, t] C [0, T). Let = to < ti ■ ■ ■ < tn ^ t he a subdivision of [0, t] C [0, T] with mesh 
S = maxi(ti — ti-i). By well-known rules of Malliavin calculus (see) we have 

where we use the symbol dW^ to denote the Skorohod integral. We note that 
Dc,w{ti-i) = for a > Therefore setting 

n 

Us{<j) = ^{w{ti) - w(ii_i))l(t^_j^t.](cr) 
1=1 

we obtain 

n 

!=1 

ft " nti 

= / Usia)dW^{a)+Y, Vw{U,^{t,))DMU)ejda. 
Recalling the equation satisfied by Dx (see (|6.13p ) we have 

n 

4=1 

t 

Us{cr)dW^ {(t) 

+ / V«;(t„x(t,))e(*'-")''(/-B)Pge,da 
4=1 

" pti pti 
+ Y, Vw{U,x{t,)) e(^-'^)^(/-B)PV„/(r,Jx(r))J7?,x(r)e,dr da. 

j— 1 ti-l o- 

(6.18) 

Now we let the mesh (5 go to 0. We discuss the three terms in the right-member of 
the above inequality separately. 

Using the continuity properties of the maps t H> x{t) and t M> Dx{t) stated in 
Proposition 16.51 and taking into account the continuity properties of w and Vw, the 
estimate (|6.17p and the chain rule D^w{t) = w{t,x{t))Dax{t), it is easy to see that 
the map t w{t) — w{t,x{t)) is continuous from [0,r] to ©^'^(X^). It follows that 
Us ^ in L^'^(X^) and by the continuity of the Skorohod integral we conclude that 
the first term in the right-member of (|6.18l) goes to as 5 0. 
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According to the definition of Vw{t,x{t)) the second term can be written as 



(I - ByPgejda 



< ^[Vu;(/ - By-']{U,^iU))iI - BfPge,{U - U-i) 
1=1 

+ - B)'-']{U,x{U)) r [e^'^-^^^ -I){I-B)'Pge,da. 

,=1 Ju-i 

We notice tliat, for every i = 0, . . . , n, 

(e(t.—)s _/)(/_ < |(e-s_/)(/_B)''Pge,| ^0, 



sup 

(TG[ti_i,ti] 



o-G[0,5] 



as 5 — >■ 0, by the strong continuity of the semigroup. From the properties of [Vw(/ 
BY~^] and the continuity of the paths of x it follows that 

Y}^w{I - Bf-^iU.^iU)) / e(*'-^)^(/-i?)^Pge,da 



f [Vw7(/ - B)i-^](r,x(r))(/ - BfPgCjdr, 
Jo 



Now recaUing that, by Proposition|n3]-[lDCTX G L°°(17; L'^{0, T; Xr,)) and the bound- 
edness of V/ we can estimate the third term in the right-member of (j6.18l) by 



J2 / ' Vu.(t„x(tO) / - B)PVuf{r,Mr))JD„x{r)e,dr da 



< 



cpjJ2\\^w{u,x{umL(x,) 



ti-i J a 



{{r - a)'^-^-" + l)dr da 



where C is a positive constant depending only on P and /. But the last term goes to 
0, P-a.s., by the continuity properties of Vw and the continuity of the paths of x. 



7. The backward stochastic differential equation. In this section we con- 
sider the backward stochastic differential equation in the unknown {Y, Z): 



{dY{T) = ^{t, x(t; t, x), Z{T))dT + Z{T)dW{T), T e [s, T], 
\r(T) = 0(x(T;.s,a:)) 



(7.1) 



where x(-; s, x) is the solution of the uncontrolled equation ()4.7p (with the convention 
:x.(t; s,x) — X for r G [0, s)) and ip is the Hamiltonian function relative to the control 
problem described in Section [T] More precisely, for < G [Q,T],x E z G S* we have 



il}{t, X, z) = inf {l{t, Jx, j) + z r{t, Jx, 7) : 7 G Z^} . 

For further use, we prove some additional properties of the function ■0: 
Proposition 7.1. Under Hvmthesis \2.1\ and \2.3\ the following holds: 



(7.2) 



Feedback optimal control for stochastic Volterra equation 



29 



1. There exists a positive constant C such that for any t G [0, T], xi, 0:2 G 
and Zx^Zi G S*, 

\\l){t,xx,zi) - i){t,xi,zi)\ < C\zi - Z2I + C(l + + |lx2||,,)||a;i - X2\\,,; 

2. Thee exists a positive constant C such that 

sup \'ip{t,0,0)\ < C. 
te[o,T] 



Proof. Point [2] follows from the fact that 



1^(^,0,0)1 



inf Z(t,0,7) 



Moreover, for all 7 G W we have 

Jx, 7) + zr{t, Jx, 7) < l{t, Jx , 7) + z'r(t, Jx' , 7) + \l{t, Jx, 7) — l{t, Jx , 7)! 
+ \zr{t, Jx, 7) - z'r{t, Jx' , 7)] 

< l{t, Jx' , 7) + z'r{t, Jx' , 7) + \l{t, Jx, 7) - l{t, Jx' , 7)1 
+ \{z^ z')r{t,Jx,-f)\ + \z'{r{t,Jx,-f)~r{t,Jx',-f)\ 

< l{t, Jx',-/) + z'r{t, Jx',7) + C|| Jllllx - x'Ul + ||x||„ + \\x'\\^) 
+ C\z-z'\+C\\J\\\\x-x'Ul + \\x\\, + \\x'Uz'\, 

and taking the infimum over 7, 

^P{t,x,z) < tl;{t,x' , z') + C\\J\\\x ^ x'\{l + \\xl, + \\x'l,) + C\z ^ z'\ 
+ C\\J\\\x~x'\il + \\x\\, + \\x'Uz'\ 
< c\z ~ z'\ + c\x - x'\{l + \z\ + \z'\){l + \\xl, + \\x'\\^) 

for some c. Exchanging x, z with x' , z' we get the conclusion. □ 
We make the following assumption. 

Hypothesis 7.2. For almost every t G [0,T] the map Tp(t,-,-) is Gateaux dif- 
ferentiahle on X^i x S* and the maps {x,h,z) ^ V2;'0(t, x, and {x,z,C,) 1— >■ 

V z'4^{t,x, z)[(^] are continuous on Xri x X x 'E.* and Xri x S* x S* respectively. 

Remark 7.3. Under the above assumption we immediately deduce the following 
estimates: 

\V.,i;it,x,z)[h]\<C{l + \\x\\^)\h\ and | V,i^(i, x, z)[C] | < C|C|, /iGX,CgS*. 



We notice that Hypothesis 17.21 involves condition on the function -0 and not on 
the functions I and r that determine tp. However, Hypothesis 17.21 can be verified in 
concrete situations (for an example, see, for instance, [2T1 Ex. 2.7.1]). 

The backward equation (|7.ip is understood in the usual way: we look for a pair 
of processes (Y, Z), progressively measurable, which, for any t G [s,T] 

Y{t)+ ( Z{T)dW{T)^(j){x{T;s,x))~ [ x(t; t, x), Z(T)dr. 



We can now state the following result on existence, uniqueness and smoothness 
of the solution to equation (|7.ip : 
Proposition 7.4. 
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1. For all X G X^, s G [0,r] and p G [0, cxd) there exists a unique pair of 
processes {Y,Z) withY G £^(17, C([s, T]; R)), Z G LP{Q.,L'^{s,T-'E.*)) solving 
the equation (j7.1l) . In the following we will denote such a solution by Y{-\ s, a:) 
and Z{-] s, x). 

2. The map {s,x) ^ {Y{-; s, x), Z{-; s, x)) is continuous from [0,T] x to 
LPin,Ci[s,T];R)) X LP{n; LHs,T;E*)). 

3. For all s G [0,r] the map x i— >■ s, a;), Z(-; s, x)) is Gateaux differ entiahle 
as a map from X,^ to LP{Vt,C{[s,T]-M)) x LP{n; L'^{s,T;E*)). Moreover, the 
map it, X, h) 1— > {VxY{ ■ ;t,x), VxZ{ ■ ; t, x)) is continuous from [0, T] x X^j x 
X to LP{n, C([s, T]; R)) x LP(f7; L\s, T; S*)). 

4-. For any x G X.^,h G X, the pair of processes {\IxY{-]s,x),\I,j,Z{-\s,x)) 
satisfies the equation 

' dV^r (r; s, x) \h\ = V^V'(t, x(t; s, x), Z(t)) V:rX(T; s, x) [h]dT 

+V,V(r, x(t; s, x), Z(T))V,Z(r; s, x)[/i]dr + V,Z(t; s, x)[h]dW{T), 
\7,Y{T; s, x) [/i] = V,0(x(T; s, x)) V,X(r; s, x) [h] , 

for T G [s,T], s G [0,T]. 

Proof. The claim follows directly from Proposition 4.8 in Fuhrman and Tessitore 
|21| . from the differentiability stated in Proposition l6.2l and the chain rule (as stated 
in Lemma 2.1 in D 

As in the previuous section, starting from the Gateaux derivatives of Y and Z, 
we introduce suitable auxiliary processes which will allow ourselves to express Z in 
terms of VY and (/ — BY~^ and then get the fundamental relation for the optimal 
control problem introduced in Section [T] 

Proposition 7.5. For every p > 2, s G [0,T], x G Xj^,h G X there exists two 
processes 

{n(t;s,a;)[/i] : t G [0,T]} and {Q(t; s, a;)[/i] : t G [0, T]} 

with n{--s,x)[h] G LP(O;C([0,r];X^)) and Q{- s,x)[h] G LP(f7; C([0, T]; S*)) smc/i 
i/iai if s £ [0, T), a; G X^i and h £T>, where 

V:^{he Xi^g C X : {leY-'h G X^] , 

then V-a.s. the following identifications hold: 

= fv.r(M,.)(/-B)-W, forallteis.n (,.3) 
^ ^ [V:,r(s;s,a;)(/-S)i-''[/i], /or a/H G [0, s); ^ ^ 

Q(i; = |v.^(t;.,.)(/-B)-«W, fora.e,e[s,T] 

' ' ^ |0, /or a/H G [0,s). ^ ^ 

Moreover the map {s,x,h) i— ?> !!(•; s, a;)[ft,] is continuous from [0,r] x x X to 
LP(rj; C([0, T]; K)) and i/ie map {s,x,h) M- s, a:)[/i] is continuous from [0,T] x 
X X into LP(f2; C([0, T]; S*)) anrf 6o</i maps are linear with respect to h. Finally, 
there exists a positive constant C such that 



E sup ||n(i;s,a;)[/i]||P+E / \Q{t; s,x)[h]\l,dt 
te[s,T] Js 

<C{T-sf-'-^^P{l + \\x\\,)P\hf^. (7.5) 
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Proof. As in the proof of ProDOsition l6.4[ we introduce a suitable stochastic differ- 
ential equation which should give the pair s, x)[h],Q(-; s, x)[h]); more precisely, 
for fixed s € [0,T],x G X,, and h € X we consider the following backward stochastic 
differential equation on the unknown (n(-; s, Q(-] s, 

dn(<; s, x)[h] = v{t] s, x)hdt + \7 ^ipitj s, x), Z{t; s, x))Q{t; s, x)[h]ds 

+ Qit;s,x)[h]dW{s) t&[s,T] (7.6) 

n(T; s, x)[h] — ri{s, x)h, 

where 

i^{t; s, x)h = l^s.T] {t)Va:'^{t, x{t; s, x),Z{t; s, x)) (e{t-, s, x)[h] + {I - B f-^e^^-'^^h}j , 
77(s, x)h = V^(j){x{T- s, x)) {q{T- t, x)[h] + (/ - B)i-«e(^-^)^/i) . 

We notice that the processes v{-;s,x)h and r](-;s,x)h are well-defined for every h G 
X. Moreover, recalling the estimates on x(-;s,x) obtained in Proposition I4.2[ the 
properties of Vxi'it, x, z) (see Remark [73)) and the bound (|6.3p on Q{-; s, x)h proved 
in l6.4[ we get 

/ T y/^ 

Ely \iy{t;s,x)hfdt\ 

< Ci E |^^^(1 + ||x(i; {\\Q{t; s,x)h\\r, + {t ~ sf-'-'^lhUf dtj 

< 6*2(1 + \{T - s)P/^ + {T- s)(2(9-'j)-iW2l 

<c3{i + \\x\\,r\hf^. 

where Ci, i — 1,2,3 are suitable constants independent on t,x and h. In the same 
way, again by (|4.2I) , (I6.3|) and by hypothesis 12.31 we get 



E|7/(s, x)hY < CE [(1 + ||x(T; s, x)||)(||e(i; s, x)h\\^ + [T - sf~'~'^)\h\xY 
<C{l + \\x\\,nT-sY'-'-^^P\hf^. 

Hence, recalling Proposition 4.3 in Fuhrman and Tessitore [21], we obtain that for ev- 
ery s G [0, T], a; G Xjj, h € X there exists a unique pair of processes (!!(•; s, x)[h], Q(-; s, a;)[/i]) 
solving the BSDE ^ such that H G £^(^2; C([0, T]; X,,)) and Q G ^^(^2; ^^(o, T; S*)). 
Moreover, inequality (|7.5p holds. 

Reasoning as in the proof of Proposition l6.41 when h G V we get the representation 
given in (|7.3p and (|7.4p . Clearly, the map /i i-t- (!!(•; s, x)[h],Q{-] s, x)[h]) is linear. 

Now we prove its continuity. By estimate (|7.5p . it is sufficient to prove that it is 
continuous with respect to s and x for any fixed h G X, and, again by Proposition 4.3 
in Fuhrman and Tessitore [H], it is enough to prove that for all /i G X, s„ s G [0, T), 
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a;„ — 7> x e we have 



\ P/2 

/^ + /^ :-E( j ||V.V(i,x"(t),Z"(i))-V.7A(t,x(t),Z(0)||i(H)dtJ 

\v[t\ s„,Xn)h ~ v(t] s, x)hfxdt j 
+ E |?;(s„, a;„)/i — ?7(s, — > 0, n — >■ cxd, 

where we set x"(t) = x{t; Sn,Xn) and — Z{t; s„,a;„). We prove that the three 

integrals goes to separately. To this end we notice that, by the continuous depen- 
dence of X and Z on the initial data, we have x" x and Z" — s- Z, respectively 
in LP{n; C([0, T]; X^)) and LP{n; L^{0, T; 2*)). Thus from each subsequence in N we 
can extract a subsequence {n^ : j € N} for which J2i W^^^ ~ x|Up(O;C([0,t];J^^) < oo 
and the series X^i-*^"' ~ ^ converges P-a.s. and for all t g [0,r] to an element 
X in LP{n;C{[0,T];Xrj)), for which ||x">(i)||,, < \\^{t)\\,, + ||x(<)||,,, P-a.s. for all 
t G [0,T] for t e [0,T]. Similarly, there exists Z in LP{n; L'^{Q,T;E*)) such that 
< II^WIIh- + \\Zit)\y, p-a.s. for all t e [0,T]. 
Now we use the above claim to prove that /" 0, as n oo, i = 1, 2, 3. Let us 
consider By the continuity assumptions stated in Hvpothesis 17.21 and the conver- 
gence of (x"' , Z"') to (x, Z), P-a.s. for all t £ [0, T] we have that V;,ip{t, x"' (t), Z"' (t)) 
converges to V :,^p{t,ji(t), Z(t)), P-a.s for all t G [0,T]. Further, by Remark m the 
function in the integral Ii is bounded by a constant independent on n G N. Hence, 
by the dominated convergence theorem we have 

IE^^||V,^(t,x"'(i),^"'W)-V.^(t,x(i),Z(i))||i(H)dtj 0. 

To prove that ^> as n — > cxo we define 

: = 1[.„.T] W (e(t; s„, + (/ - i3)i-»e(*-^")^/i) 

and 

: = W (e(t; s, + (/ - i?)i-«e(*-^)^ft) , 

and we notice that iy{t; s„, x„) = Va;V(i, x"(0: Z"(i))V^"(i) and s, x) = Va;V(i, x(t), 
Then 



r,' < CiE 



p/2 



|(V,V(i; x"(t), - V,^(t; x(t), Z(i))) V^WI' 



+ C2E |V,V'(x"(t), Z"(i))(V^"W - dtj 

_rri I rri 
—-'21 + -'22- 

Taking into account the continuity assumption and the bound on Vxilj{t, x, z) (see 
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respectively Hypothesis 17.21 and Remark I7.3|) , we have 



E sup |(V,V(i;x"W,Z"(t))-Vx^(t;x(t),Z(t)))r 
*e[o,T] 

< CE sup (l + ||x"(i)||,, + ||x(t) 11^)2 

te[o,T] 

< C(l+ ||X„||^+ 11x11^)2 

Further \Vit)\^ < c1[^,t] + and 2(6i-r;-l) > -1 (since 6i-?7 > 1/2. 

Hence, reasoning as it was done for Ii we can apply the dominated convergence 
theorem and obtain that I21 0, as n -> 00. To show that I22 — > 0, as n ^> 00, we 
apply Holder inequality to E /^f |V^i/;(x"(t), - V{t))f dt to get 



p/2 



E 



< E 



< C E 



|V,^(x"(t),Z"(t))(T/"(i)-l^(t))|'dt 

l/r 



|V.V(i,x"(t),Z"(t))|2'-dd ( r \V"it)-Vit)f''dt] 



p/2 



p/2r 



(l + ||x"(i)||,f'-dt 



p/2q\ 



|V"(t) - V(t)|2'?dt 



<CE 1+ sup ||x"(t)||?; 
te[Q,T] 



IV'it) -V{t)\^''dt\ 



p/2q\ 



<cfl+E sup ||x"(0||„^ TP^'-eI f -F(OP«dA 

for every r,q such that l/r + l/q = I. By the above inequality we see that I22 — ^ 
0, n ^ 00 if ^ y in LP{n; ^^^(o, T; X^)). To prove this limit we first note that 



E 



p/g 



\hs^,T]{t)Q{t;Sn,Xn)[h] - l[s,T]{t)&{t; S, x)[h] 



,2q 



since the map {s,x) ^ Q{-;s,x) is continuous with values in L^'(r2; C([0, T]; X^)). 
Hence it remains to show that 

in L2^([0, T]; Xjj). To this end we note that for all s+ \ s and s we have 



2g 



dt 



2q 



dt + 



2g 



dt 
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provided q is sufBciently close to 1, since 9 — rj > 1/2. 

In a similar way as it has been done for I2, we can prove that — 0, n — ;> 00. □ 

We are now in the position to give a meaning to the expression \/xY{t, s, x){I — 
BY^^ and, successively, to identify it with the process Z{t;s,x). 

Corollary 7.6. Setting v{s,x) = Y{s;s,x), we have v e C{[0,T] x X,^;R) 
and there exists a constant C such that \v{s,x)\ < C(l + \x\)'^ , t G [0,r], x e Xrj. 
Moreover v is Gateaux dijferentiable with respect to x on [0,T] x and the map 
{s]x,h) I— >■ \7v{s,x)[h] is continuous. 

Moreover, for s G [0, T) and x G the linear operator h 1— > Vv{s, x){I — B)^^^h 
- a priori defined for h E V (with D as in 1 6. 1\) - has an extension to a bounded linear 
operator from X into R, that we denote by [Vw(/ — B)^~^]{s, x) . 

Finally, the map {s,x,h) 1— >■ [Vv{I — B)^~^]{s, x) is continuous as a mapping from 
[0, T) X X,^ X X into M. and there exists C > such that 

|[V«(/ - By-'is,x)]h\x < C{T - + \\x\\r,)\h\x. 

t e [0,T), xgX^, hex. (7.7) 

Proof. We recall that Y{s\ s,x) is deterministic. 

Since the map (s, x) ^ Y{-; s, x) is continuous with values in LP{n;C{[0, T]; R)), 
p >2, then the map {s,x) 1-^ Y{s] s,x) is continuous with values in LP(r2;R) and so 
the map (s, x) H> EF(s; s, x) — Y{s; s, x) — v{s, x) is continuous with values in R. 

Similarly 'Vxv{s,x) ~ EVxY{s;s,x) exists and has the required properties, by 
Proposition 17.41 Next we notice that n(s; s, x)h = \/xY{s] s, x){I — By~^h. The ex- 
istence of the required extensions and its continuity are direct consequence of Propo- 
sition [7?5] and estimate 17.71 follows directly from (|7.5|) . □ 

Corollary 7.7. For every t G [0,r], x G Xr, we have, P-a.s. 

y(t;s,x) = w(t;x(i;s,a;)), for all t e [s,T], (7.8) 

Z(t;s,x) = [Vv{I - B)^-^]{t;x{t;s,x)){I - BfPg, for almost all t e [s,T]. 

(7.9) 

Proof. We start from the well-known equality: for < s < r < T, P-a.s. 

x(<; s, x) = x(t; r, x(r; s, x)), for all t £ [s, T]. 

It follows easily from the uniqueness of the backward equation (|7.ip that P-a.s. 

Y{t;s,x) = F(t;r,x(r;s,x)), for aU t G [s,T]. 

Setting s = r we arrive at (|7.8I) . 

To prove (|7.9p we consider the joint quadratic variation of {Y{t; s,x))t^[s.T] and 
W on an arbitrary interval [s,t] C [s, T); from the backward equation (I7.ip we deduce 
that this is equal to Z{r] s, x)dr. On the other side, the same result can be obtained 
by considering the joint quadratic variation of {v{t,x{t; s,x)))t^[s^T] and W. Now by 
an application of ProDOsition l6.7l (whose assumptions hold true by Corollarv l7.6p leads 
to the identity 

Z(r;s,x)dr = j [Vv(I ~ By-'^]{r,x{t; s, x)){I - Bf Pgdr, 
and (|7.9p is proved. □ 
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8. The Hamilton-Jacobi-Bellman equation. Let us consider again the so- 
lution x(t; s, x) of equation (14.11) and denote by P^ t its transition semigroup: 

Ps,t[h]{x) = Eh{x{t;s,x)), x e X,,,0 < s<t<T, 

for any bounded measurable h : X ^ R. We notice that by the bound (|4.2I) this 
formula is meaningful for every h with polynomial growth. In the following Ps^t will 
be considered as an operator acting on this class of functions. 
Let us denote by Ct the generator of Ps^t- 

Ct[h]{x) = iTr[(/ - B)PgV^h{x)g*p*{I - B)*] 

+ {Ex + B)Pf{t, Jx), Vh{x)), 

where Vh and V^/i are first and second Gateaux derivatives of h at the point x ^ X 
(here we are identified with elements of X and L(X) respectively). This definition is 
formal, since it involves the terms (/ — B)Pg and (/ — B)Pf which - a priori - are 
not defined as elements of L{X) and the domain of £t is not specified. 

The Hamilton-Jacobi-Bellman (jgJ_B|) equation for the optimal control is 

(§-^v{t,x) + £tHt,-)]{x) ^ ^{t,x,Vv{t,x){I - B)Pg), te[0,T], xeX, 
\v{T,x) = (l3{x). 

(HJB) 

This is a nonlinear parabolic equation for the unknown function v : [0,T] x X^ — >■ M. 
We define the notion of solution of the ^HJB^ by means of the variation of constant 
formula: 

Definition 8.1. We say that a function v : [0,T] x Xj^ ^ R is a mild solution 
of the Hamilton - Jacobi - Bellman equation ^HJB]i if the following conditions hold: 

1. V G C([0,T] X X;R) and there exist constants C, m > such that \v(t,x)\ < 
(7(1-^1x1)", te [0,r], x€X; 

2. V is Gateaux differ entiahle with respect to x on [0,T) x Xri and the map 
{t, X, h) i-> Vv{t, x)[h] is continuous [0, T) x x X — > R; 

3. For all t S [0,T) and x S the linear operator k ^ Vv{t,x){I — B)^~^k 
( a priori defined for k E V) has an extension to a bounded linear operator on 
X ^R, that we denote by [\/v{I - 

Moreover the map (t,x,k) i— >■ [Vf(/ — BY^^]{t,x)k is continuous [0,T) x 
Xri X X — > M and there exist constants C,m >0, kg [0, 1) such that 

\\[Vv{I-By-'']{t,x)\\^x)<CiT-t)-'^{l + \\x\\,r, te[0,T),xeXr,. 

4- The following equality holds for every t G [0,T], a; G X^^: 

v{t,x) - Pt,Tmx) - J Pur [^(r, •, [S7v{I - By-']ir, •)(/ - BfPg] {x)dr. 

(8.1) 

Remark 8.2. We notice that Proposition \ 7. 1\ implies that \^(t,x,z)\ < C(l + 
\z\ + \x\'^), so that if V is a function satisfying the bound required m of the above 
Definition we have 

\i;{t,x, [Vv{I - B)^-<']{t, x){I - BfPg)\ < C{T - i)-'^(l + ||x||,)™+2 
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and formula (j8.1|) is meaningful. Now we are ready to prove that the solution of 
the equation iHJB^i can be defined by means of the sohition of the BSDE associated 
with the control problem (14.11) . 

Theorem 8.3. Assume Hypothesis \2.1[ \2.2\ and \2.3[ there exists a unique mild 
solution of the Hamilton - Jacobi - Bellman eauation lH J B\ The solution is given by 
the formula 

v{t,x) =Y{t;t,x), (8.2) 

where ['x,Y,Z) is the solution of the forward-backward system (j4.ip and (|7.ip . 

Proof. We start by proving existence. By Corollary 17.61 the function v defined as 
in (|8.2p has the regularity properties stated in Definition 18.11 In order to verify that 
equality (|8.ip holds we first fix t G [0, T] and x G Xrj. We notice that 

i^it, ; v{t, ■), [\7v{I - BY-<^]{t, .)(/ - B)'>Pg){x) 

= ^{t, ■,Y{t- 1, •), [Vr(/ - By-']{t, .)(/ - BfPg){x) 

and we recall that 

[V«(/ - By-']it; x(t; s, - BfPg - Z{t; s, x). 

Hence 

Ps,t [^{t, ; v{t, •), [Vv{I - B)^-']{t, .)(/ - BfPg)] [x] 

= E [V-lt, x(t; t, x),Y{t; t, x(i; t, x)),Z{t; t, (x(t; t, x)))] . (8.3) 

On the other hand, the backward equation gives 

Y{t;t,x)+ [ Z{r;t,x)dr ^ <j){yi{T;t,x)) - [ i:{r,x{r;t,x),Z{r;t,x))dr. 



Taking the expectation we obtain 

v{t,x) = Pt^rMx) -E i;{r,x{r;t,x),Z{r;t,x))dr 

and substituting in the integral the expression obtained in ()8.3|) we get the required 
equality (|8T|) . 

Now we consider uniqueness of the solution. Let v denote a mild solution. We 
look for a convenient expression for the process v{t,x{t; s, x)), t G [s, T]. By (|8.ip and 
the definition of Ps,t we have 

v{t,x) =E[(f>{x{T;s,x))] 

E [i}{r, x(r; s, x), [Vw(/ - B)i~^](r, x(r; s, xj){I - BfPg)] dr. 

Since x(i; s, x) is J-j-measurable, we can replace the expectation by the conditional 
expectation given Tt'. 

v{t,x) =E^' [0(x(r;s,x))] 



x(r; s, x), [Vu(/ - B)i~^](r, x(r; s, x)){I - BfPgdr 
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Moreover, recalling that for any r G [t, T] the equality 

x(r; t, x(i; s, x)) = x(r; s, x) 
hold P-a.s. we can replace x by x(t; s, a;) to get: 
v{t, x(i; s, x)) = E-^' [(/>(x(T; s, x))] 



— w^t r 



T 

1- 



?/'(r,x(r;t,2;), [Vt;(/ - S)i"^](r, x(r; - ByPgAr 



+ ^ x(r; x), [Vz;(/ - Bf-\r, x(r; - B)'Pgdr, 

where we have defined 
e:=(/)(x(r;t,a;)) 

T 

V-Cr, x(r; x), [Vv{I - B)'-']{r, x(r; t, x)){I - BfPg)dr. 

Now we notice that E-^= = E-^= x(<; s, x))] = w(s, x). Since ^ e L^(il;M) is J^- 
measurable, by a well-known g theorem there exists Z £ Ljr{fl x [s, T]; L2(S; M)) such 
that E-^*[^] = Z{r)dW{r) +v{s,x) We conclude that the process v{t,x{t; s,x)), 
t G [s,T] is a real continuous semimartingale with canonical decomposition 

u(t,x(i;s,x)) = ^ Z{r)dWir) +v{s,x) 

+ f ij{r,Mr;t,x),[Vv{I - By-']{r,^{r-t,x)){I - BfPgdr, (8.4) 



into its continuous martingale part and continuous finite variation part. 

Now we compute the joint quadratic variation process of both sides of the above 
equality with W on an arbitrary interval [0, t] C [0, T). By the assumtpion made in[3] 
we have that there exists a constant Kt such that || Vw(s, x)||L(jf) < Kt{l + ||x||,;)™, 
for s € [0,t], X € Xjj-, then we can apply Proposition 16.71 to conclude that the joint 
quadratic variation equals 

[ [Vvil - B)i-®](r,x(r;s,x))(/ - B fPgdr. 
Jo 

Computing the joint quadratic variation of the left-hand side of (|8.4p with W yields 
the identity 

/ [Vv{I - B)^-'']{r,x{r;t,x))(I - BfPgdr ^ [ Z{r)dr. 

Jo J s 

Therefore, for a.a. t£ [s, T], we have P-a.s. [Vv{I - Bf~'']{r,yL{r; s,x)){I - Bf Pg = 
Z{r), so substituting into (|8.4p and taking into account that v{T, x(T; s, xj) — (t){x{T; s, a 
we obtain, for i G [s, 

z;(t,x(i;s,x)) -h / [yv{I - By-'^]ir,:>c{r; s,x)){I - Bf PgdW{r) 



(x(T;5,x))- / i;{r,x{r;t,x),[Vv{I - By-'']{r,x{r;t,x)){I - BfPgdr. 
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Comparing with the backward equation 17. II we notice that the pairs 
{Y{t;s,x),Z{t;s,x)) 

and 

iv{t, x(t; s, x)), [Vv{I - Bf-%{r, x(r; s, x))(I - B)'>Pg = Z{r)) 

solve the same equation. By uniqueness, we have Y(t] s, x) — v{t; x(t; s, x)), t € [s, T], 
and setting t = s we obtain Y{t; t, x) = v{t, x). □ 

9. Sinthesis of the optimal control. In this section we prooced with the 
study of the optimal control problem associated to the stochastic Volterra equa- 
tion For fixed x G an admissible control system (a.c.s.) is given by 
U = j;, (:Ft)t>n-J, (W{t))t>on) where 

1. {Cl,J^,P) is a complete probability space and {J^t)t>o is a filtration on it 
satisfying the usual conditions; 

2. T4^(t))t>o is a cylindrical P- Wiener process with values in S and adapted to 
the filtration {J-t)t>o, 

3. 7(<) G U, P-a.s. for a. a. t G [0,T] where W is a fixed subset of U. 

To each (a.c.s.) U we associate the mild solution of the Volterra equation 

' ^ IL - s)u''{s)ds = Au^it) + fit, u{t)) 

u^{t)=uo{t), t<0. 

We have showed in Section |3] that we can associate to such equation the controlled 
state equation 

'dxU(t) = Bx"(t)dt + (/ - B)P fit, Jx"(t)) 

+ (/ - B)Pgirit, JxU(0, 7(i))dt + dWit) 

^xU(O) 

Our purpose is to minimize a cost functional of the form 

J(uo, V)=E [ lir, u"(r), 7(t))dt + E(^(u"(r)). 
Jo 

To this end we will consider its translation in the state space setting, where the cost 
functional is of the form 

lix, U) = E / lit, Jx"(t), 7(t))dt + £<?!)( Jx'^(T)). 

We will work under the assumptions given in Hypothesis 12. 1[ 12.21 and 12.31 We recall 
that the Hamiltonian corresponding to our control problem is given by 

ipit, X, z) :— inf {lit, Jx, 7) + zrit, Jx, 7) : 7 G [/} 

7ew 



and we introduce the set of minimizers of (j7.2p : 

Tit, X, z) := {7 G [/ : lit, Jx, 7) + zrit, Jx, 7) — ipit, x, z)} . 
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The existence of a minimizer for the Hamiltonian is not a direct consequence of our 
setting. Then we require it exphcitly. 

Hypothesis 9.1. T{t,x,z) is not empty for for allt G [0,T], a; G Xj, and z G S*. 

Under this assumption, by the Filippov Theorem (see, e.g. O Theorem 8.2.10, 
p. 316]) there exists a measurable selection of F, a Borel measurable function /i : 
[0,T]x xE-^U such that 

ip(t, X, z) = l(t, Jx, ^{t, X, z)) + zr{t, Jx, fi{t, X, z)) 

t G [o,r], X G Xrj,ze E*. (9.1) 

Further, by v we wiU denote the solution of the Hamilton- Jacobi-Bellman equation 
relative to the above stated problem 

i§^v{t,x) + CtHt,-)]{x) = i;{t,x,Vvit,x){I - B)Pg), tG[0,r], x e X, 
\v{T,x) = (/)(a;). 

(HJB) 

As it was shown in the previous section, l\HJB]i admits a unique mild solution. 

As stated in the introduction, we wish to perform the standard synthesis of the 
optimal control problem, that is to say, which consist in proving that the solution 
of the iHJB^ equation is the value function of the control problem and allows to 
construct the optimal feedback law. To be able to use nonsmooth feedbacks we settle 
the problem in the framework of weak control problem. Again we follow the approach 
of Fuhrman and Tessitore [H] with slight modifications. 

The first step is to prove the so called fundamental relation, which gives a char- 
acterization of the value function of the control problem in terms of the solution of 
the Hamilton- Jacobi-Bellman equation. 

Proposition 9.2. Let v be the solution of l\HJB^ . For every admissible control 
system U = (f2, J^, (J^()t>o, P, 7) and for the corresponding trajectory starting at 
X G Xjj we have 

I{x, 7) — v{0, x) 

+ E r {a, x"(a)), [V^;(/ - By-'^]{a, x^{<j)){I - BfPg) da 

+ E /^[Vw(/ - Bf~%{a, x"(a))(/ - BfPgria, Jx^ {r),j{<j))d<j 
Jq 

l-T 

+ E / ?(cr, Jx"(CT),7(cr))dcr. 
"'0 

Proof. The proof follows from the same arguments used in the proof of Theorem 
7.2 in ^21, and is, therefore, omitted. Just notice that in this case by Theorem 18.31 
we have Z{t;s,x) = [Vv{I - BY-^]{t,yi{t; s,x)){I - B)^ Pg and the role of G in [2ll 
Theorem 7.2] is here played by (/ — B)Pg. □ 

A straightforward consequence of Proposition [9?2] is the so-called Verification The- 
orem. 

Corollary 9.3. For every admissible control system U = (f2, J^, (7^i)f>o, P, 7) 
and initial datum x G X^, we have J(a;, U) > w(0, x), and the equality holds if and only 
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if the following feedback law holds V-a.s. for almost every t G [0,r]; 

j{t) = M(i,x"(i), [\7v{I S)i-^](i,x"(i))(/ - BfPg) 
P-a.s. for a.a.t e [0,T], 

where is the trajectory starting at x and corresponding to the control 7. In this 
case the pair (7(-), x'^(-)) is optimal. 

We are now in the position to state the existence and uniqueness of the so-called 
closed loop equation, which is given by 

'<hC<{t) = BTC<{t)dt +{I - B)Pf{t, Jx^it)) 

+ (/ - B)Pgir{t, Jx^(f), 7(t, x^(<)))dt + dW{t)) (9.2) 

^x(O) = X. 
where 7 is given by 

7(i, x) := fi{t, X, [Vv{I - B)^-<']{t, x){I - BfPg). (9.3) 
The main result of this section thus reads as follows: 

Proposition 9.4. For every t G [0,T],x G X^, the closed loop equation (|9.2p 
admits a weak solution (J^t), P, W^, x(t))f>o) which is unique in law and setting 

7(t) = Kt,m, [Vv{I - B)'-']{tMt)){I - BfPg) 

we obtain an optimal admissible control system {fl,J-, (J-f), P, W^, x(i))f>o, 7). 

Proof. Let us take an arbitrary set up {ft, J-, (J-'t), P, W) and consider the solution 
(x(t))t>o of the uncontrolled equation 



dx(t) = Bx(t)dt + (/ - B)Pf{t, Jx(t)) + (/ - B)PgdW{t) 
x(0) = X, 



(9.4) 



which exists in virtue of Theorem (|4.2p . Now we define the control 
7(t) = ^l{t,±{t), [Vvil - B)'-']{tMt)){I - BfPg) 

and the process 

r(cr,x(cr),7(r))dr, tG[0,r]. 

Since the function r is bounded, by Girsanov theorem there exists a probability 
P on (51, J^) equivalent to P, such that is a P- Wiener process with respect to 
{J-t). Rewriting equation (|9.4I) in terms of W we conclude that x is the required 
solution of (19.21) . Now applying Proposition 19.21 and Corollary 19.31 to the a.c.s. 
(J-t),P,VF,7,x(t)) with 

7(t) = /i(t,x(t), [Vvil - B)'-']{t,i{t)){I - B)'Pg) 

we obtain the required conclusions. □ 
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